I'm wanting to create a REST API for TV listings in my country. While online aggregations of TV listings do exist they're too tied to the presentation to be of any use to software developers.
In order to get hold of this information I'm thinking of going to each source and scraping the relevant information. While I've obtained similar information from HTML pages before it was an extremely cumbersome process. Do any Python features/libraries exist that would make this process easier?
Another option is to use lxml.html. I've occasionally found this to handle some pages better than BeautifulSoup (odd HTML comment corner cases), and the API may be more familiar if you've worked with XML. If BeautifulSoup does handle certain pages better, you can still use it while retaining the same interface by using soupparser module.
While BeautifulSoup is a good piece of code, depending on what you are trying to extract from the web page, you may not need that much intelligence. The data you're looking for may be easily picked out by a regular expression, for example.
This isn't answering you question directly, but you may want to think about getting your data from another service, such as Schedules Direct. They provide XML, and it's the recommended data provider for xmltv.