I've been wracking my brain for a couple of weeks on this. I need to create a web client (I don't want to use the webBrowser control because I need this to be as lightweight as possible) to log in to a secure web site, and then effectively click links and fill in fields to get the data that would normally be displayed in the web browser. I'm then going to parse the data and perform other actions with it.
I have been working with HttpWebRequest and HttpWebResponse and many permutations of suggestions I have found while Googling my issue, but I can't get rid of my problem: Sometimes when I effictively click the ultimate link that I need to click to get to my data, I get what I am looking for. However, MOST of the timel, I get a response page that tells me my connection timed out and that I need to log in again. I have tried messing with cookies and such, but to no avail.
I know it's good form to post my code, but it is so sloppy and screwed up right now from tweaking this and trying that, that I'd rather not take the approach of fixing what's there, rather I'd like to start with solid, clean code to begin with.
Your help will be greatly appreciated.
Thanks,
ALo