tags:

views:

41

answers:

1
Q: 

performing full text searches on huge amount of docs

Suppose you have huge amount of documents, a few millions, and more coming. Suppose you have to publish them on a website with hundreds of thousands of daily pageviews, and suppose you have to let the visitors perform searches on all the documents. What is the best way to store/retrieve the documents? And to perform searches on them?

Currently the system i'm talking about uses swish-e to create indexes for static html files. These files are served as static content to the users.

Is this a good way?

What's the best solution between a database to store and search the contents (MySQL) and store the contents in static files and use a tool to index them and perform searches (Swish-e)?

+1  A: 

If you can get your site indexed properly, you can try installing Google Site Search and be done with it.

If you want to have your own search, consider using Lucene. IMO, it's far superior to MySQL Full-Text Search.

Anton Gogolev  2010-01-29 14:27:51
I get my site indexed properly, it's a matter to know if i'd better switch to a faster system (if it exists) to perform internal searches or not.
Mirko Rossini  2010-01-29 14:52:12

related questions

Remove Quotes and Commas from a String in MySQL
What's the best way of converting a mysql database to a sqlite one?
How do you manage databases in development, test, and production?
Multiple foreign keys?
Add 1 to a field (MySQL)
Issues using MS Access as a front-end to a MySQL database back-end?
Bigger than a char but smaller than a blob
How do I retrieve my MySQL username and password?
Long-time LAMP Developer moving to VB.NET
How do I Concatenate entire result sets in MySQL?
Full complete MySQL database replication? Ideas? What do people do?
SQL: Distribution of table in time
SQLite vs MySQL
How do I create a new Ruby on Rails application using MySQL instead of SQLite?
Multiple Updates in MySQL
MySQL/Apache Error in PHP MySQL query
What all do I need to escape when sending a (My)SQL query?
Auto Generate Database Diagram MySQL
Mechanisms for tracking DB schema changes
How big can a MySQL database get before performance starts to degrade.
Python and MySQL
SQL Server 2005 implementation of MySQL REPLACE INTO?
How to export data from SQL Server 2005 to MySQL
Throw Error In MySQL Trigger
Binary Data in MySQL