fulltext

Is it possible to get a list of relevant words from a full-text index given a specific row?

I wuld like to do som automatic tagging of incoming text in our system and I was wondering if a full-text index is capable of providing a a ranked list of words given an indexed row. If not, do you have any suggestions on how to do this? We already have a system in place for auto tagging but its fairly brute-force (aka. slow) in its met...

Searching with words one character long (MySQL)

I have a table Books in my MySQL database which has the columns Title (varchar(255)) and Edition (varchar(20)). Example values for these are "Introduction to Microeconomics" and "4". I want to let users search for Books based on Title and Edition. So, for example they could enter "Microeconomics 4" and it would get the proper result. My...

MySQL Match Against query does not work with Urlencoded string

This is the table. CREATE TABLE `posts` ( `post_id` int(20) NOT NULL AUTO_INCREMENT, `post_archived` enum('Y','N') COLLATE utf8_unicode_ci NOT NULL DEFAULT 'N', `post_updatedts` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP, `post_author` int(20) NOT NULL DEFAULT '0', `post_date` timestamp NOT NULL D...

SQL join on a table using freetext SQL server 2005

Table A has columns question varchar(200) objective varchar(200) Table B has columns + a fulltext index solution varchar(max) I am trying to output a flat merge of these matching a.objective with the TOP 5 solutions from Table B for the keywords in A.objective. where freetext(text,A.objective) e.g. "question one", "objective one",...

FULLTEXT search on a very small column

I have a table Books in my MySQL database which has the columns Title (varchar(255)) and Edition varchar(20)). Example values for these are "Introduction to Microeconomics" and "4". I want to let users search for Books based on Title and Edition. So, for example they could enter "Microeconomics 4" and it would get the proper result. My ...

FULLTEXT search in MySQL does not return any rows

I am a bit lost, this looks like some silly mistake - but I have no clue what that can be. Here is the test session: mysql> drop table articles; Query OK, 0 rows affected (0.02 sec) mysql> CREATE TABLE articles (body TEXT, title VARCHAR(250), id INT NOT NULL auto_increment, PRIMARY KEY(id)) ENGINE = MYISAM; Query OK, 0 rows affected (...

Is there any point in creating a second column optimized for FULLTEXT searches?

Hi, the project I'm working on has for each column that needs to be searched a second column called "ft[columnname]" which has a FULLTEXT index and only this one is searched against. This column contains an "optimized" text, that is automatically generated from the original column in the following way: The string is lowercased All acc...

Ordering FULLTEXT searches on relevance and other fields

I'm using FULLTEXT natural language search, and I notice that it automatically sorts my results by relevance. However, when I start to add things to ORDER, it seems to no longer sort by relevance. Is there a way to explicitly set the importance of relevance sorting? ...

Dynamic tags generation from sql server database using full text search

Hi, Is there any solution to generate list of tags (common phrases/words) from sql server full text index. I store some data in xml data type column. I would like to generate common words from that column (performance is on the first place). data changes frequently. ...

Are there any mysql storage engines with row locking, and fulltext?

Im using fulltext for searches on my site, but there are a lot of updates being done to the table also, which contains 700,000 records. these updates are usually done via cron, by a script that runs every 10 minutes and commits changes from a temporary table where I simply INSERT all the changes for speed purposes, since updating the liv...

Does a FULLTEXT index speed up LIKE conditions?

We have a system that is migrating from an older VARCHAR using LIKE setup to one that uses FULLTEXT indexes. So far everyone is enjoying the switch, but we still have some code that isn't catered to the FULLTEXT queries. Currently we have a column that is a VARCHAR(255) and we want to remove the 255 character limit. What will happen to ...

SQL Server Full-Text Rankings Example

So far, I'm not getting meaningful results from my full-text queries so I decided to give a simple example of what I am trying to do and the results I expect. I've made the the following test table (tblCars) with full-text enabled for the column [Car] and primary key [CarID]. CarID Car ----- ----------------- 9 BMW 330Ci 2009 14 ...

MySql Question --- Problems with fulltext search

I have 2 fulltext seach indexes, one for users and one for posts, every time a user signs up he gets added to that table for user_search and when when ever a user makes a post .. the post gets added to the post_search MYISAM table. Now the thing is, I discovered that for some reason my latest inserted items are not appearing in search. ...

How can I compare a variable to a MySQL full-text index without a gigantic loop?

Let's say I've got two tables: NOTES has two columns: ID and BODY. BODY is a FULLTEXT index. KEYWORDS has two columns: ID and KEYWORD. I want to search every BODY for every KEYWORD and get one row for each match, the NOTES.ID and the KEYWORD.ID. So if there were 15 notes and each one matched 3 keywords, I would get 45 rows. But as ...

mysql fulltext MATCH,AGAINST returning 0 results

I am trying to follow: http://dev.mysql.com/doc/refman/4.1/en/fulltext-natural-language.html in an attempt to improve search queries, both in speed and the ability to order by score. However when using this SQL ("skitt" is used as a search term just so I can try match Skittles). SELECT id,name,description,price,image, MATCH...

FULLTEXT search with a multi-language column

Is there a way to use FULLTEXT in a multi-language table without giving each language its own column? I have one column I need to search, but the language in that column varies: ProductID int Description nvarchar(max) Language char(2) Language can be one of: en, de, it, kr, th Currently I build a concordance and use that for...

Perform a full text search for partial matches where shortest match has the highest relevance in MySQL?

I'd like to perform a fulltext search against a column, looking for a partial word match (IE: against('fra*' in boolean mode)). But I would like to receive results that assign a higher relevancy to shorter words that match. So, for example, if I perform a search for 'fra' and get the results 'frank', 'fran' and 'frankfurter', I would ...

Can I define which word breakers to use when building a mssql fulltext index?

I have created a fulltext catalog that stores the data from some of the columns in a table, but the contents seem to have been split apart by characters that I don't really want to be considered word delimiters. ("/", "-", "_" etc..) I know that I can set the language for word breaker, and http://msdn.microsoft.com/en-us/library/ms34518...

SQL Sever 2008 / Office 2007 Full text index issues

Server is running 2008 R2 Standard 64 bit and SQL Server 2008 R2 Workgroup Edition (64-bit) We store documents in a varbinay(max) and the full text indexes work perfectly for all document types including PDF’s but do not work for Office 2007 documents. We have installed the Office 2007 iFilter and done each step but still do not get a...

FULLTEXT query with scores/ranks in Postgresql

Im new to Postgres and I dont know how to translate this MySQL query to postgres: SELECT pictures.id, MATCH (title, cached_tag_list) AGAINST ('phrase') AS score FROM pictures WHERE MATCH (title, cached_tag_list) AGAINST ('phrase') ORDER BY score DESC; ...