I am looking for a script (php prefably) to give me all the links of a website

Question

Hello,

I have come across lots of code which will find all the links on a page. I would like something that takes it a step further and finds it for the whole site.

Spidering the links is a little trickier than in seems!

Any ideas will be greatly received.

Answer 1

Just feed the links you find on the pages back into the function that gets the links for one page. Keeping track of which pages you have done and making sure you don't jump out to another domain.

Answer 2

theres a function written at http://www.onderstekop.nl/articles/114/ I think the example there does exactly what you need to.