full-text-search

Is there anything terrible about setting ft_min_word_len=2 for MySQL FULLTEXT searches?

In order to do FULLTEXT searches on 2-letter phrases such as "PR Manager" and "MS Word", I have added *ft_min_word_len=2* to the MySQL config file (/etc/mysql/my.cnf). Is there anything particularly wrong with doing this? Will it reduce performance? Will it prevent scaling to large datasets? Any comments would be appreciated. ...

Multiple synonym dictionary matches in PostgreSQL full text searching

I am trying to do full text searching in PostgreSQL 8.3. It worked splendidly, so I added in synonym matching (e.g. 'bob' == 'robert') using a synonym dictionary. That works great too. But I've noticed that it apparently only allows a word to have one synonym. That is, 'al' cannot be 'albert' and 'allen'. Is this correct? Is there any ...

SQL Queries failing with: The execution of a full-text query failed. "The content index is corrupt."

Suddenly many queries to my SQL Server 2005 database are failing with this SQL error: The execution of a full-text query failed. "The content index is corrupt. Anyone know of a fix? ...

How to weight in full-text search

I want to search on a phrase, for example "search preference". I want to return the phrase itself as most heavily weighted. Next I would want to return "search" and/or "preference". And, in lowest ranking, I would want "searching" or "searches" or "preferences". I don't know what to put for weights in the IsAbout. 'ISABOUT( "search prefe...

Encrypted Fields & Full Text Search, Best Approach?

I've got some fields that store notes and sensitive information that I'd like to encrypt before it makes its way into the database. Right now, I use a SQL Full-Text Search to search these fields. Obviously encrypting this data is going to throw off my search results. What's the best way to encrypt these fields, but still allow searchi...

How can I find all initializations in a text?

Hello, I have to find all initializations (captial letter words, such as SAP, JSON or XML) in my plain text files. Is there any ready-made script for this? Ruby, Python, Perl - the language doesn't matter. So far, I've found nothing. Regards, Stefan ...

Best way to implement search functionality using innoDb

Hi, I need to implement something like a full text search on a couple if index's in a large products table, using innodb, MyISAM is not an option due to its lack of transactions and relationship support. I can think of a couple of ways of doing this, plugin, stored procedure, search table with keys and copied index's in MyIsam format. ...

Implementing 'Search' functionality on website

I have a website which has thousands of (ever increasing) resources in it. I implemented the usual Sql Full text Search and it was working fine until recently. I noticed some performance issues with it. I am using MySql Database with C#. NET as the back-end code. I just need few valuable suggestions from you so that I can take those i...

Which search index should be used with php and postgresql clustered

When writing a PHP application which search index should be used if you want to index a lot of documents in a clustered fashion. Is there a simple library to do the job? Is there something like lucene for php? ...

ft_min_word_len set in local my.cnf?

Is it possible to set ft_min_word_len for a certain user (such as by placing a my.cnf file in the user home dir with ft_min_word_len set)? The documentation says I need to restart the server after making this change, but a user does not have access to do that. ...

Which full-text search package should I use for SQLite3?

SQLite3 appears to come with three different full-text search engines, called FTS1, FTS2, and FTS3. The documentation available on the website mentions that FTS1 is stable, FTS2 is in development, and that you should use FTS2. Examples I find online use FTS3, which is in CVS, and not documented versus FTS2. None of the full-text searc...

SQLite Query - Need Help with Full Text Search

Here's what I'm trying to do. User (a): Enters data in two fields (description-1) and (description-2). User (b) Enters similar data in opposite fields. User (a) or (b) search on both fields would find a match. A good analogy would be a dating search. User (a) enters a description of themselves and the match they are looking for, and...

Query SQl Server 2005 Full Text Search noise/stop words

Is it possible to get the list of Full Text Search noise/stop words from SQL Server 2005 by querying the database? I am aware that the noise words are in a text file ~/FTData/noiseEng.txt but this file is not accessible to our application. I've look at the sys.fulltext_* tables but these don't seem to have the words. ...

Help with Search Engine Architecture .NET C#

I'm trying to create a search engine for all literature (books, articles, etc), music, and videos relating to a particular spiritual group. When a keyword is entered, I want to display a link to all the PDF articles where the keyword appears, and also all the music files and video files which are tagged with the keyword in question. The...

Full-search text query

I want to add simple full-search-text to my webapp, that can accept multiple words to search. Example search entry: "Online SQL books" Should I transform it to: WHERE (CONTAINS(myColumn, '"Online*" and "sql*" and "books*"' )) or : WHERE (CONTAINS(myColumn, '"Online* sql* books*"' )) or maybe: WHERE (CONTAINS(myColumn, '"Onlin...

Full text search stored procedure error

This is the error I am getting: Syntax error near 'online' in the full-text search condition '""online"*" and "and*" and ""text"*"'. This is my stored procedure: ALTER PROCEDURE dbo.StoredProcedure1 ( @text varchar(1000)=null ) AS SET NOCOUNT ON declare @whereclause varchar(1000) SET @whereclause = @text SELECT articles...

Identifying accurate matches from SQL Server Full Text Search

Hello I am using SQL Server 2008 Full Text Search, and joining to the FreeTextTable to determine ranking of results. How do I determine whether the result set is giving an accurate match or not? For example, for one search I may get these results: Manufacturer | Rank =================== LG U300 ------- 102 LG C1100 ------ 54 LG GT50...

Choosing a stand-alone full-text search server: Sphinx or SOLR?

I'm looking for a stand-alone full-text search server with the following properties: Must operate as a stand-alone server that can serve search requests from multiple clients Must be able to do "bulk indexing" by indexing the result of an SQL query: say "SELECT id, text_to_index FROM documents;" Must be free software and must run on Li...

"Sounds like" query in Google

"Sounds like" based on Soundex or Metaphone is not uncommon option for proprietary full text search in databases ( Oracle, MS SQL Server ) or open source search engines such as Lucene. I have a difficulty using Google :) to find out whether anything similar does exist for advanced Google search. Regarding wildcard search it seems to be...

Using NOT keyword with full-text search and multiple columns

Is it possible to use the CONTAINSTABLE and NOT keywords with SQL Server full-text searching and exclude rows where a single column contains the value to be excluded? For example, let's take the following indexed view (simplified for the purposes of illustrating this problem): ItemId INT FirstName VARCHAR(200) MiddleName VARCHAR(200) L...