tags:

views:

411

answers:

2

Hi,

Can any one suggest me the best way to get Hits( no of occurrences ) of a word per document in Lucene?..

A: 

SpanTermQuery.getSpans will give an enumeration of docs and where the terms appears. The docs are sorted, so you can just count the number of times each doc appears, ignoring the position info.

Coady
+2  A: 

Lucene uses a field-based, rather than document-based, index. In order to get term counts per document:

  1. Iterate over documents using IndexReader.document() and isDeleted().
  2. In document d, iterate over fields using Document.getFields().
  3. For each field f, get terms using getTermFreqVector().
  4. Go over the term vector and sum frequencies per terms.
  5. The sum of term frequencies per field will give you the document's term frequency vector.
Yuval F
+1. You may have to consider the stemming and other transformations that the text has undergone. For example, if you searched for the word "beauty" on a stemmed field, the actual term from the index would be "beauti."
Shashikant Kore