views:

15

answers:

1

I'm trying to use scrubyt to scrape a page and have everything working except for a decent way of advancing to the next page of the results. The next_page approach isn't working due to the url being relative.

I figured out a simple way to do it but it all hinges on being able to use something like:

if node_exists("//div[@class='pagination']")
A: 

um...mechanize maybe? watir?

rogerdpack