How does it finds the back links of the websites and how does it remember.I have heard robots.txt.But dont have a much knowledge.
A:
It's already searching the web, remember. It doesn't need to find backlinks, it just needs to remember the forward links it found.
Jon Hanna
2010-08-17 16:55:52
But the pagerank is totally based on backlinks right ? then how does it know the backlinks of websites ?
S.M.Karthick
2010-08-18 09:16:20
1. Pagerank hasn't been based purely on backlinks for over a decade.2. If I look at webpage A and see a link to webpage B, then I know that webpage B is linked from A. Google only knows about links from pages it sees on the rest of its search (which is why backlinks from non-robotable resources don't help pagerank).
Jon Hanna
2010-08-18 09:21:58