How can I use VB.Net to read the content returned from a URL?

Question

Below is the example code I'm using to get this to work and it does work if I try to read yahoo.com.

Here is the problem. The address I need to read is a java servlet that processes parameters passed in, generates a text document on the server, and then redirects to another URL and returns the address of the text file on the server. I then need to download that text file and process it. I'm having problems connecting to the first URL with the parameters and I think it has to do with the redirect.

I'm using the WebRequest object and I've tried using the HttpWebRequest object. Are there any other objects that support redirects?

TIA

    Dim reader As StreamReader
    Dim request As WebRequest
    Dim response As WebResponse
    Dim data As String = ""

    Try
        request = WebRequest.Create("URL Here")
        request.Timeout = 30000
        response = request.GetResponse()
        reader = New StreamReader(response.GetResponseStream())
        data = reader.ReadToEnd()
    Catch ex As Exception
        MsgBox(ex.Message)
    End Try

    Return data

Answer 1

Edit

I just tested out HttpWebRequest.Create() and that does handle the 301 and 302 fine with out extra code.

Can you post the error you are seeing

---

You could cast the WebResponse to a HttpWebResponse:

I need to convert this to VB... but it might help you start:

var response = request.GetResponse() as HttpWebResponse;

if (response.StatusCode == HttpStatusCode.Moved || response.StatusCode == HttpStatusCode.Redirect)
{
    // Follow Redirect,  new request based off Redirect
}

// Read Data

Answer 2

I think I found something that will work.

I used a WebBrowser control instead.

Have a button that runs this code...

WebBrowser1.Navigate("URL Here")

And this function to process once the request returns.

Private Sub WebBrowser1_Navigated(ByVal sender As System.Object, ByVal e As System.Windows.Forms.WebBrowserNavigatedEventArgs) Handles WebBrowser1.Navigated

MsgBox(WebBrowser1.DocumentText)

End Sub

Answer 3

I believe you just have to set the AutoRedirect property.

request.AutoRedirect = true;