Getting DocumentSteam for html websites without using a Winforms WebBrowser control for parsing?

Question

Getting DocumentSteam for html websites without using a Winforms WebBrowser control for parsing?

Is this possible? I would like to create some types like:

HtmlDocument doc = new HtmlDocument ("http://www.ms.com");
DocumentStream ds = doc.GetFullStream();

...

Also if possible, please post code.

Answer 1

Have you tried using the HTML Agility Pack for html parsing, instead of an ui element?

Answer 2

You may also use WebClient:

    String url = "http://www.ms.com";
    WebClient client = new WebClient ();

    // Add a user agent header in case the 
    // requested URI contains a query.

    client.Headers.Add ("user-agent", "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; .NET CLR 1.0.3705;)");

    Stream data = client.OpenRead (url);
    //Do stuff here
    //StreamReader reader = new StreamReader (data);
    //string s = reader.ReadToEnd ();
    //Console.WriteLine (s);
    data.Close ();
    reader.Close ();