ruby + save web page

Question

To save the HTML of a web page using ruby, it's very easy. One way to do is by using rio :

require 'rubygems' require 'rio' rio('http://www.google.com') > rio('google.html')

It is possible to do the same for by parsing the html, requesting again the different image,s js, css and then save each of them. I think it is not very efficient. So, is there a way to save a web page + all the images, css, and javascript that are related to that page .... and all this automatically.

Answer 1

what about system("wget -r -l 1 http://google.com")

Answer 2

Most time we can use the system's tools. Like dimus said, you can use the wget to download page.

And there are many useful api for solving the Net problem. Such as net/ftp, net/http or net/https. You can see the document for detail. Net/HTTP .But these methods only get the response, what we need do more is parsing the HTML document. Even more using the mozilla's lib is a good way.