Say for example I wanted grab the results from the first 3 pages in Google. So basically I want the top 30 results. I can go about grabbing the first 10 on page 1, but how do I tell Curl that once page one is done, "click" the second page and so on?
+2
A:
Just take a closer look at the URLs:
First page:
http://www.google.com/search?q=lmgtfy
Second page:
http://www.google.com/search?q=lmgtfy&start=10
deceze
2009-07-18 05:17:41
props for acronym usage.
seth
2009-07-18 05:19:21
perfect for my example! - but let's say that in any other scenario, the pagination links were obscure and you couldn't increment the value, Is it possible to make Curl "click" onto another page?
Keith Donegan
2009-07-18 05:23:04
deceze
2009-07-18 05:26:30
Thank you Deceze
Keith Donegan
2009-07-18 05:28:06