Ok, today I added a little patch to the hack, now it works... most of the time.
This hack needs some work. We need to play with the gstreamer settings a bit. In it's current state, it runs around 85% cpu and the frame rate is at best 1 frame a second. Next task is to implement the system using farsight and telepahty.
Remy also showed us some of the civx system. It is an interesting piece of software, and a great idea!