Can any of Ruby's HTML Parsers do Javascript to see the resulting DOM?

Question

When trying Hpricot and Nokogiri, the HTML can be fetched and parsed, but can they also execute the Javascript as well so that the content shows on the page? (shows up in the the DOM). That's because some page won't show the info unless the Javascript interpreter has run.

Answer 1

Not that I know of. You might want to look into using something like Watir and use a real browser.

Answer 2

Have a look at Capybara. I haven't used it myself but I read about it the other day and it seems like it can execute javascript without using a browser.

Answer 3

Take a look at envjs and jhonson gems.