tags:

views:

191

answers:

1
Q: 

Natural Language Processing Package

I have started working on a project which requires Natural Language Processing. We have do the spell checking as well as mapping sentences to phrases and their synonyms. I first thought of using GATE but i am confused on what to use? I found an interesting post here which got me even more confused.

http://lordpimpington.com/codespeaks/drupal-5.1/?q=node/5

Please help me decide on what suits my purpose the best. I am working a web application which will us this NLP tool as a service.

+2  A: 

You didn't really give much info, but try this: http://www.nltk.org/

I don't think NLTK does spell checking (I could be wrong on this), but it can do parts of speech tagging for text input.

For finding/matching synonyms you could use something like WordNet http://wordnet.princeton.edu/

If you're doing something really domain specific: I would recommend coming up with your own ontology for domain specific terms.

adam  2010-03-05 15:01:51
There are multiple domains for which the analysis has to be done. What would you suggest in such a case. For a basic set up what can i use. Something like a GATE.. How useful can it be?
Arkid  2010-03-05 16:51:21
It depends how closely they match a given ontology (such as WordNet). If you are using most terms in the same way that a pre-defined ontology is, then you don't need to roll your own. If you are using the same terms in different ways then you may need to create a new one. If you have multiple domains that use terms in different ways, then you may need to create more than one.
adam  2010-03-05 17:42:52

related questions

Natural Language/Text Mining and Reddit/social news site
tf-idf and previously unseen terms
What are good starting points for someone interested in natural language processing?
How can I use NLP to parse recipe ingredients?
How to ensure user submit only english text
Latent Dirichlet Allocation, pitfalls, tips and programs
Stemming algorithm that produces real words
Named Entity Recognition Libraries for Java
Theory: "Lexical Encoding"
Methods for Geotagging or Geolabelling Text Content
What would the best tool to create a natural DSL in Java?
What options do you recommend for language translation on content driven Web sites?
NLP: Building (small) corpora, or "Where to get lots of not-too-specialized English-language text files?"
A StringToken Parser which gives Google Search style "Did you mean:" Suggestions
Contextual Natural Language Resources, Where Do I Start?
NLP: Qualitatively "positive" vs "negative" sentence
How do I determine if a random string sounds like English?
Word frequency algorithm for natural language processing
Your favorite natural language parser?
How to read values from numbers written as words?
How Do You Categorize Based On Text Content?
Is there an algorithm that tells the semantic similarity of two phrases
Vista speech recognition in multiple languages
What's a good natural language library to use for paraphrasing?
Natural language date/time parser for .NET?