views:

28

answers:

1

Here is my code in python which Genrates a list of link objects. I want to remove duplicates form them.

cb = list()
for link in br.links(url_regex="inquiry-results.jsp"):
        cb.append(link)
print set(cb)

But It returns the error unhashable instance. link is something like this -

Link(
    base_url='http://casesearch.courts.state.md.us/inquiry/inquirySearch.jis',
    url='/inquiry/inquiry-results.jsp?action=..........',
    text='12',
    tag='a',
    attrs=[('href', '/inquiry/inquiry-results.jsp?action=.......'),
    ('title', 'Go to page 12')]
    ),

[Added newlines and dots just for convenience]

How can I remove duplicates?

+3  A: 

You can construct a dictionary using URLs as keys and the get its values:

cb = {}
for link in br.links(url_regex="inquiry-results.jsp"):
    cb[link.url] = link
print cb.values()
Lukáš Lalinský