Scrape web page contents

Question

I've just started looking into this, I want to scrape my Netgear Router (http://192.168.0.1/setup.cgi?next_file=stattbl.htm) stats into a csv file.

I run Win & Linux, but mainly know C++, any links/solutions?

Answer 1

i know and wrote c++, but for screen scraping i'd rather use some scripting language like python with some handy libraries, e.g. http://www.crummy.com/software/BeautifulSoup/

especially on linux, python should be installed already (or at least easily installable via package managers).

Answer 2

As MYYN suggested, something like BeautifulSoup or Hpricot really excels at this sort of thing, so if you aren't absolutely convinced that it has to be in C++, you really should look into those(the basics of both python and ruby can be picked up pretty quickly and are certainly much simpler than C++). Alternatively, check out QTDOMDocument and TinyXML++.