tags:

views:

84

answers:

0
Q: 

Nokogiri Doc Element Not Returning Correctly

I am trying to scrape a wiktionary entry:

uri = URI.parse("http://en.wiktionary.org/wiki/" + CGI.escape('abjure'))
doc = Nokogiri::HTML(open(uri, 'User-Agent' => 'ruby'))

but the doc shows no elements for this word. The other words work fine and this word used to work. I have no idea what changed. Anyone see anything wrong with this?

related questions

How do you screen scrape ajax pages?
How can I scrape an HTML table to CSV?
Download image file from the HTML page source using python?
Scrape a dynamic website
Is there a PHP equivalent of Perl's WWW::Mechanize?
Perl: HTML Scraping from an Authenticated website
How do screen scrapers work?
What are some good methods to hinder screen scrapers from grabbing specific pieces of content off my site?
What is the best way to parse a web page in Ruby?
Reading and posting to web pages using C#
What's a good tool to screen-scrape with Javascript support?
Add RSS to any website?
Is there another way to do screen scaping apart from regular expressions?
screen scraping a command window using .net managed code
how to save a public html page with all media and preserve structure
Saving HTML tables to a Database
Getting HTML from a page behind a login
Export ASPX to HTML
Python regular expression for HTML parsing (BeautifulSoup)
How to use webclient in a secure site?
Extract Address Information from a Web Page
HTML Scraping in Php.
How to fetch HTML in Java
How to implement a web scraper in PHP?
Options for HTML scraping?