Data Mining open source tools

Question

Hi

I'm due to take up a project which is into data mining. Before I jump in I wanted to probe around for different data mining tools (preferably open source) which allows web based reporting. In my scenario the all the data would be provided to me, so I'm not supposed to crawl for it.

In n nutshell, am looking for a tool which does - Data Analysis, Web based Reporting, provides some kind of a dashboard and mining features.

I have worked on the Microsoft Analysis Services and BOXI and off late I have been looking at Pentaho, which seems to be a good option.

Please share your experiences on any such tool which you know of.

cheers

Answer 1

I believe WEKA is the best open source DM software out there.

Check it: http://www.cs.waikato.ac.nz/ml/weka/

Answer 2

I am a python-er myself and I have to say:

Yes! All of that can be done in Python.

I last played around with Beautiful Soup[0]. It's a really simple to use module that lets you grab/mine data from html and xml (excellent for 'screen scraping').

If you dont know python, .... well It's really easy to learn.

[0]http://www.crummy.com/software/BeautifulSoup/

Answer 3

Weka is great, but you might want to try the Orange Data Mining toolkit instead.

http://www.ailab.si/orange/

Edit: And as of November 2010, I must say I really like KNIME.

Answer 4

R has a lot of excellent packages related to data mining. In particular, look at:

• The machine learning view on CRAN.
• The natural language processing view on CRAN.

It also ties into Weka (see the RWeka package). And it can be integrated with either .Net (through COM) or Python (through RPy or RPy2).

I would agree regarding Pentaho for a reporting platform, although it's a very large project depending upon what you're using it for.

Answer 5

Pentaho is a very professional solution. Definitely a very good choice.

Answer 6

You can look at Data Mining SDK and its blog.

Answer 7

A list of some open source data mining tools are listed here: http://dataminingtools.net/browse.php

Answer 8

you can take a look at data mining tool, weka

Here is a link to a collection of tutorials and videos on WEKA Tutorials:http://www.dataminingtools.net/browsetutorials.php?tag=weka 

Videos: http://www.dataminingtools.net/videos.php?id=6 

Answer 9

You should also check out Apache Mahout . It can be quite useful for some large-scale machine learning tasks such as user clustering.

Answer 10

Eclipse BIRT http://www.eclipse.org/birt/phoenix/project/description.php

Answer 11

Have a look at list of Open Source software's for Machine learning maintained by JMLR. you can find it here:

http://mloss.org/software/

http://jmlr.csail.mit.edu/mloss/

They represent State of Art!

My issue with Weka is that a number of algorithms in it are outdated.

Answer 12

I believe KNIME deserves to join this list as well.

Answer 13

i believe RapidMiner is an excellent tool that should be added to this list.