Hey Friends
Whats does "indexing" mean? How it is useful to a web crawler?
A:
Internal indexing in a database and the index that a web crawler looks at are two different concepts.
Indexing in a database is a method to make looking up records by certain columns faster.
Indexing in the context of web crawlers involves storing web pages and building an index based on what's in them so as to access them by content more easily.
FrustratedWithFormsDesigner
2010-08-17 16:15:08
"building an index based" did this means DB Indexing?
Jesvin
2010-08-17 16:16:31
@Jesvin: In this case, "index" is used in a more general sense of the word. Think of it like the index at the back of a book. In reality, it *could* be implemented using a relational database and there probably would be database indexing in that case, but it could also be implemented with an XML file, flat text file, or something else entirely.
FrustratedWithFormsDesigner
2010-08-17 17:38:23