ansaurus

Question

How to use lxml to get a message from a website?

Answer 1

+5 A:

BeautifulSoup is more suitable for html parsing than lxml.

something like this can be helpful:

def get_weather():
    import urllib
    from BeautifulSoup import BeautifulSoup
    data = urllib.urlopen('http://exam.com/').read()
    soup = BeautifulSoup(data)
    return soup.find('p', {'id': 'resultWeather'}).findAll('b')[-1].string

get page contents with urllib, parse it with BeautifulSoup, find P with id=resultWeather, find last B in our P and get it's content

barbuza 2009-10-30 08:03:29

Thanks. I already know how to do it. However, still an issue. I want to get the 2nd "b", rather than the last. Parameters to do this?

Tran Tuan Anh 2009-10-30 08:37:50

Well? I don't know how exactly it works, but from the last line it is obvious, that you should supply a different list index.

shylent 2009-10-30 08:40:32

Try using `.findAll('b')[1]` instead of `.findAll('b')[-1]`.

Dominic Rodger 2009-10-30 09:36:03

You can check out pyquery aslo. It has jquery-like syntax and is built ontop of lxml, so it's much faster than BeautifulSoup.

Baresi 2009-12-11 02:35:56

ansaurus

tags:

views:

answers:

How to use lxml to get a message from a website?

related questions