Do you need to set up a Linux cluster first in order to setup a Hadoop cluster ?
A:
According to this tutorial : http://wiki.apache.org/hadoop/Running%5FHadoop%5FOn%5FUbuntu%5FLinux%5F%28Single-Node%5FCluster) you can setup Hadoop on a single machine also.
Himanshu
2009-10-01 06:13:53
I know that, I already did it ... I am a newbie to clusters, and so I wanted to know if if you need to setup a Linux cluster first to get setup a Hadoop cluster ?
Abhinav
2009-10-01 08:54:40
+1
A:
No. Hadoop has its own software to manage a "cluster". Just install linux and make sure the machines can talk to each other.
Steve
2009-10-01 18:05:05
A:
Deploying the Hadoop software, along with the appropriate config files, and starting it on each node (which Hadoop can do automatically) creates the cluster from the Linux machines you have. So, no, by that definition you don't need to have a separate linux cluster. If your question is whether or not you need to have a multiple-machine cluster to use Hadoop: no, you can run Hadoop on a single machine for either testing or small-sized jobs, via either local mode (where everything is confined to a single process) or pseudodistributed mode (where you trick Hadoop into thinking it's running on multiple computers).
Jakob Homan
2009-11-07 18:59:05