where can i find papers on Web Spiders and AI ?

Question

im interested in finding algorithms or appraoches in developing spiders which follow some AI or crawling model highlighted in computer science papers..

where can i find such papers?

Answer 1

Google Scholar

Answer 2

You can try web search for the information retrieval and text mining algorithms. Most of the real-world data acquisition techniques are based on the very general ideas from these disciplines. A good book on data mining will also help (e.g. Data Mining: Practical Machine Learning Tools and Techniques by Witten & Frank).