I need to create a site map/list,but I need the link-name to show up as well.
What I mean by that is given , say , www.google.com , I need the following list to be created.
Google - www.google.com
Images - http://images.google.com/imghp?hl=en&tab=wi
...
My Account - http://images.google.com/imghp?hl=en&tab=wi
Personal Information Edit - https://www.google.com/accounts/EditUserInfo
...
My Products - https://www.google.com/accounts/EditServices
...
Privacy - http://www.google.com/intl/en/privacy.html
...
The list needs to be bound to a domain , say us.example.com.
I have tried a depth first search using a python script, with Beautiful Soup to parse the links. Not happening.
Anybody have any ideas on how they would do it?