views:

396

answers:

2

When I executed a MapReduce program in Eclipse using Hadoop, I got the below error.
It has to be some change in path, but I'm not able to figure it out.
Any idea?

16:35:39 INFO mapred.JobClient: Task Id : attempt_201001151609_0001_m_000006_0, Status : FAILED
java.io.FileNotFoundException: File C:/tmp/hadoop-Shwe/mapred/local/taskTracker/jobcache/job_201001151609_0001/attempt_201001151609_0001_m_000006_0/work/tmp does not exist.
    at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
    at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
    at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519)
    at org.apache.hadoop.mapred.Child.main(Child.java:155)
A: 

Considering the error message ([...]6_0/work/tmp does not exist), the first issues to check are:

Extract:

If you installed it correctly, you should be able to start the MapReduce perspective and Map/Reduce view. Both are under Window > Open Perspective and Show View respectively.

  • Click the blue elephant on the upper right corner of the Map/Reduce view. It'll bring up a configuration window.
  • Type in any name for the the Location Name. I just called it localhost cluster.
  • Set the port numbers for Map/Reduce Master and DFS Master. Look in your conf/hadoop-site.xml for "mapred.job.tracker" and "dfs.default.name" respectively. If not in that file, then it is probably in hadoop-default.xml or hadoop-env.xml.
  • Click "Advanced Parameters" tab and set the "mapred.job.tracker" parameter. For some reason it doesn't automatically change when you change it in the "General" tab.
  • User name should be whoever owns hadoop. For me, it is just my login, others make a separate "hadoop" user for hadoop.
  • If you have done everything correctly, you should be able to click the triangles on the left to span the hierarchy view.
VonC
A: 

Were you able to solve the problem ? I am getting similar problem. Please send solution if you have.

shri