This isn't a HTML parsing Question. This is about taking a look at pixels on the screen itself.
How would I, with python, look at all the pixels in a programs window.
Following advice, I am narrowing my OS field to win32. If a X-Platform solution exists, this is the place.