读书人

pig 部署在hadoop 23下

发布时间: 2012-09-27 11:11:17 作者: rapoo

pig 部署在hadoop 23上
pig-0.10.0版本是支持hadoop 23的。
但是需要重新编译pig;
编译命令如下:

ant -Dhadoopversion=23


编译好之后,把原来的pig的jar包删了就行。
当然了,hadoop的几个环境变量还是要配置的:
HADOOP_HOME

参考资料:http://hortonworks.com/blog/new-features-in-apache-pig-0-10/

引用Pig 0.10.0 supports Hadoop 0.23.X. All unit and end-to-end tests passed with hadoop-0.23. To run Pig with hadoop-0.23, you need to recompile Pig with hadoopversion flag set to 23:
ant -Dhadoopversion=23
You also need to set up all of the environment variables necessary to run the hadoop -23 client, plus, point HADOOP_HOME to HADOOP_COMMON_HOME, and make sure $HADOOP_HOME/bin/hadoop exists.

读书人网 >开源软件

热点推荐