There's actually already some open source progress for this at the Eyetap project [0]. Looks like it might be dead though.

[0] http://eyetap.org/