tags:

views:

30

answers:

1
+1  Q: 

very large mysql full-text database - slow with large search results

I have a 9-million-row table in a MySQL database that needs full-text search against three of its fields. We thought the hard part would be finding that one-in-9-million row, but that's not what we ran up against.

Our problem is that one of them is a "location" field, so searches for "poughkeepsie" come back super-fast, but searches for "new york" take forever. Even to simply count the results, it appears MySQL JOINs the index to the table, which is slow.

There are three or four questions I could ask, or would ask a consultant that specialized in this kind of thing, but I'd really like Stack Overflow's opinions on one thing. Does it make any sense to consider any other open source database in this situation? This feature worked flawlessly in MS SQL, and there's pressure now to consider it again. I'd rather not, but if Postgres will have exactly the same full-text indexing problems, maybe that's what we're stuck with.

Thanks.

+1  A: 

Have a look at Sphinx and stick with mySQL.

Pete  2010-06-24 21:44:58
that's actually the first thing we're trying. had some trouble compiling it for linux, but it seems to do the trick.
dnord  2010-06-25 00:23:13
I've not had experience with postgres' performance with that dataset size, so I don't know if switching would help. Sphinx should definitely help without having to change RDBS at this point. Good luck!
Pete  2010-06-25 00:30:58

related questions

Remove Quotes and Commas from a String in MySQL
What's the best way of converting a mysql database to a sqlite one?
How do you manage databases in development, test, and production?
Multiple foreign keys?
Add 1 to a field (MySQL)
Issues using MS Access as a front-end to a MySQL database back-end?
Bigger than a char but smaller than a blob
How do I retrieve my MySQL username and password?
Long-time LAMP Developer moving to VB.NET
How do I Concatenate entire result sets in MySQL?
Full complete MySQL database replication? Ideas? What do people do?
SQL: Distribution of table in time
SQLite vs MySQL
How do I create a new Ruby on Rails application using MySQL instead of SQLite?
Multiple Updates in MySQL
MySQL/Apache Error in PHP MySQL query
What all do I need to escape when sending a (My)SQL query?
Auto Generate Database Diagram MySQL
Mechanisms for tracking DB schema changes
How big can a MySQL database get before performance starts to degrade.
Python and MySQL
SQL Server 2005 implementation of MySQL REPLACE INTO?
How to export data from SQL Server 2005 to MySQL
Throw Error In MySQL Trigger
Binary Data in MySQL