tags:

views:

125

answers:

1

I'm trying to use Scrubyt to navigate around a website, but whenever I use it to click any links it gives me 403 Forbidden errors. The website doesn't require logins or anything so I don't understand this. Might it need some kind of session variable, or the right UserAgent string. Any idea how I might fix this?

+1  A: 

I think this may be the same issue as your other question here:

http://stackoverflow.com/questions/168868/how-to-get-next-page-link-with-scrubyt