hadoop配置常见错误及解决方法
1配置文件中使用IP地址错误:
(logs目录下的日志文件错误)
10/11/09 17:19:06 INFO mapred.JobClient: Task Id : attempt_201011091659_0001_m_000003_0, Status : FAILED
Error initializing attempt_201011091659_0001_m_000003_0:
java.lang.IllegalArgumentException: Wrong FS: hdfs://192.168.75.17:9000/hadoop/hadoop/hadoop/tmp/mapred/system/job_201011091659_0001/job.xml, expected: hdfs://hadoop_namenode:9000
??????? at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:310)
??????? at org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:99)
??????? at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:155)
??????? at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:453)
??????? at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:745)
??????? at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1664)??????? at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:97)
??????? at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1629)
解决方法:
??? 将IP地址更换为域名,如:master,salver1....
??? 修改hosts文件。
原来的格式:
<property>
?<name>mapred.job.tracker</name>
?<value>192.168.75.17:9001</value>
</property>
应该改成
<property>
?<name>mapred.job.tracker</name>
?<value>master:9001</value>
</property>
?
完善中