Library for simulating HTTP transactions like a browser with cookie and session support

Question

I wonder if there is a .NET library that mimics a browser in terms of HTTP transactions. In other words I am going to make multiple GET/POST requests and I want the cookies to be persisted to a storage, so that consecutive request will be identified by the remote host. AFAIK cURL has support for this functionality.

Answer 1

Take a look at Fiddler. Its actually a debugging proxy which is handy for capturing an initial conversation. Its built in .NET and is quite scriptable in .NET languages.

Answer 2

The built in System.Net.HttpWebRequest class has support for cookies, but they are disabled by default for security reasons. You can enable them and persist them using CookieContainer