Does anyone know if there are standards / api to crawl news articles from most of the biggest news sources.
I'm using rss to index them but I would like to classify them with more data than just their titles.
well most of the news sources don't add the main content of their articles in the feeds no ?
mnml
2009-11-19 20:10:55
Sadly, no... You'll have to write your own crawler/spyder to get everything.
Trick
2009-11-20 08:10:41