views:

125

answers:

1

I need to create a site map/list,but I need the link-name to show up as well.

What I mean by that is given , say , www.google.com , I need the following list to be created.

Google - www.google.com
Images - http://images.google.com/imghp?hl=en&tab=wi
...
My Account - http://images.google.com/imghp?hl=en&tab=wi
    Personal Information Edit - https://www.google.com/accounts/EditUserInfo
    ...
    My Products - https://www.google.com/accounts/EditServices
...
Privacy - http://www.google.com/intl/en/privacy.html
...

The list needs to be bound to a domain , say us.example.com.

I have tried a depth first search using a python script, with Beautiful Soup to parse the links. Not happening.

Anybody have any ideas on how they would do it?