views:

33

answers:

1

I would like to know if there is a solution to control a "virtual web browser" with any language (but preferably PHP or C#). This "virtual web browser" would be have just like a normal one, but it is completely hidden from the user. This means the Javascript is executed and javascript cookies handled.

I want to use this to login to a site from 2005 and pull data from it. All the authentication cookies and links are done with Javascript so I want essentially automate a process I do almost daily. This would require loading the site setting all the Javascript cookies, then send Javascript to the browser.

I have tried doing this with curl in PHP and have had no luck. The authentication scheme is so convoluted it makes me sick.

+1  A: 

We use iMacros Scripting Edtion for a similar task. It controls the web browser and can be used for web scraping.

MikeK
perfect! thanks!
Ramblingwood