Writing Crawler for Screen Scrapping

Question

I want to write crawler for screen scrapping

What I want is, I want to get price of particular hotel from a website, like here is website

e.g. In the above URL, there is list of hotels and its price. I want to get the price of the beaufort

Please Advise how to accomplish this.

Thanks

Answer 1

use a HTML parsing library like the html agility pack to parse the html into a more usable model and then navigate the model to find the bits of the HTML you are interested in

Answer 2

Screen-scraper has a software package and some tutorials that could help you.

Answer 3

download the HTML with a tool like cURL and then use XPath to select the tags you are interested in. Use Firebug to help you determine the XPath.