Has someone seen the actual SQL ( or bigtable or whatever ) code that actually makes the search in some major search engine like google, yahoo, etc? I'm just curious.
(please don't close, let me reformulate if it's not acceptable as a SO question)
Yes, but google lacks something that forums and SO have: people that answer.
Petruza
2009-07-30 17:47:27
But maybe www.google.com/codesearch has the code you're looking for. It was a bad joke, sorry.
Rob Elliott
2009-07-30 18:01:48
A joke but true indeed, "search engine source code" seems to mean "source code search engine" for google every damn time.
Petruza
2009-08-01 13:33:50
+2
A:
I suspect that actually 'making the search' is only half of it, and that a lot of the interesting stuff is done when the site is crawled - things like how indexes are generated, how ranking is calculated, etc.
Tom Haigh
2009-07-30 16:18:52
+1
A:
I'm an ex web search guy (not in this space anymore) who had written/seen significant amount of code for one of the search engines you mentioned.
Nutch is an open source web search engine you can take a look at if you're curious. Just imagine better (faster, more automated and scalable) versions of Nutch :)
obecalp
2009-07-30 18:55:07