I wanna write a crawler to fetch data. from an asp.net site which uses javascript to do the pagination
+2
A:
Use CURL Library to get html code of each page, then you must only parse this pages. For other type of page you must write other parser, do it on a DOM Library then parsers will have few lines for each type of page.
But you must have permission to do this, you must ask the author of agree of what you doing.
Svisstack
2010-10-31 09:41:46