How does the fair use doctrine apply to websites in terms of screen-scraping? The particular example I am thinking of is extraction of the useful data from a website, and re-presentation of the raw data aggregated with data from other similar websites. For example, suppose one was to extract data from a variety of websites to produce a ...
Following on from my question on the Legalities of screen scraping, even if it's illegal people will still try, so: What technical mechanisms can be employed to prevent or at least disincentivise screen scraping? Oh and just for grins and to make life difficult, it may well be nice to retain access for search engines. I may well be pla...
A client of mine who is a social sciences researcher at a university is asking if I can write a spider to do statistical data mining from a subscription-only academic database. He would like to use the statistics for his academic research. (For those interested, this would involve downloading thousands of text documents and then doing l...