BeautifulSoup - modifying all links in a piece of HTML?

Question

Hello,

I need to be able to modify every single link in an HTML document. I know that I need to use the SoupStrainer but I'm not 100% positive on how to implement it. If someone could direct me to a good resource or provide a code example, it'd be very much appreciated.

Thanks.

Answer 1

Maybe something like this would work? (I don't have a Python interpreter in front of me, unfortunately)

from BeautifulSoup import BeautifulSoup
soup = BeautifulSoup('<p>Blah blah blah <a href="http://google.com"&gt;Google&lt;/a&gt;&lt;/p&gt;')
for a in soup.findAll('a')
  a.href = a.href.replace("google", "mysite")

result = str(soup)

Answer 2

from BeautifulSoup import BeautifulSoup
soup = BeautifulSoup('<p>Blah blah blah <a href="http://google.com"&gt;Google&lt;/a&gt;&lt;/p&gt;')
for a in soup.findAll('a'):
    a['href'] = a['href'].replace("google", "mysite")
print str(soup)

This is Lusid's solution, but since he didn't have a Python interpreter in front of him, he wasn't able to test it and it had a few errors. I just wanted to post the working condition. Thank's Lusid!

Answer 3

Hi Guys ...... i am just writing a program that crawls a website in python. ...
i am not that good with python,please can any one write a simple code that just get the links on a website and store them in an array or something .............. ?

Please