views:

104

answers:

0

Possible Duplicate:
How to write a crawler?

I am interested in learning about how web crawlers and other similar "robots" work, does anyone have any recommendations on reading material (preferably free and online)? Note: i am not interested in building a web crawler, I'm just interested in how they work.