I am trying to go through a site with a bunch of links. I click on a link, save the page, click on a button, save a page. Then go back and repeat it for a huge number of links. I want to write a script to do that for me. I know C++ but I want to do Javascript for this, what is a good place to get me started? What would be a good IDE to use?
Javascript is the right choice!
GreaseMonkey!
.. or you can try witr or AutoIt.
Let us know how this goes :-)
firebug! it's a firefox add-on, and allows you to set breakpoints and debug, as well as to explore the page in terms of css, html, javascript, and such.
it's a powerful, wondeful tool.
It sounds like you want to create a crawler or spider (like what a search engine does to look for content). There are lots of tools you can use for that. Someone mentioned wget
, which has options for recursively downloading / crawling pages.
If you want to do it within the browser you could try Greasemonkey or Chickenfoot.
If you want to use a scripting language to follow links, fill forms, click buttons, and save pages you could use these kinds of libraries:
- Python: twill
- Perl: WWW::Mechanize