full-text search on bigtable

Question

any insight as to making/optimizing full-text searches on bigtable using java? best practices and such? how do u guys do it?

Answer 1

I wrote this article on text search in appengine with java a while back

http://dunelmtechnology.co.uk/text-search-with-google-app-engine/

Basic idea is to build an index as a list property from the text (stemmed and with stop words removed). To improve performance use "relation indexing" by moving the list property into a child entity. This prevents a potentially large list from being loaded as part of the default fetch group - you only need to query against. You'll have to use the low level api to do a keys only query taht will return the keys of the parent class which can then be used to fetch teh matching items.