Is there a way to see the tree of a website? Let's say: www.randomsite.com has a folder at root, named "idunno" which contains a file "hello.html". Is there a way to browse these like using explorer?
+1
A:
The web server has to have directory browsing turned on. Many sites turn it off for security purposes.
Patrick Regan
2009-10-05 14:09:45
A:
There are two ways:
You can crawl all pages on the site and build a map of all the URLs and extract paths from that.
You can become Google and ask the site admin to send you a sitemap.xml.
After that, you can write a tool which displays the map as a tree.
Background: Many web sites don't use folders on disk but databases to store their content. So on the web the notion "folder" doesn't always make sense.
Aaron Digulla
2009-10-05 14:11:20
What if a page i need is not linked in any of the public pages?
Gabriele Cirulli
2009-10-05 14:17:42
In this case (unless directory browsing is turned on) you won't be able to find out this file exists.
DmitryK
2009-10-05 14:22:46
is there any program that does that, without having to make one myself?
Gabriele Cirulli
2009-10-05 14:34:09
Ask in a cracker forum, they might have something. :/
Aaron Digulla
2009-10-05 14:39:05