obviously, i think its overkill for me to run a spider that will crawl the internet autonomously like google or yahoos.
so i am wondering, if there is some way i can access a major search engine's database, instead of scraping them ?
obviously, i think its overkill for me to run a spider that will crawl the internet autonomously like google or yahoos.
so i am wondering, if there is some way i can access a major search engine's database, instead of scraping them ?
Nope. You're already violating terms of use policy by scraping them. That kind of information is carefully guarded for obvious reasons.
Google and Yahoo both have APIs:
http://code.google.com/apis/ajaxsearch/
http://developer.yahoo.com/search/
But like everybody else said, we need more info about what you're trying to do to help you.