读书人

hadoop-Streaming实施C代码实例

发布时间: 2012-07-08 17:43:44 作者: rapoo

hadoop-Streaming执行C代码实例

?

C Code

Map: Mapper.c

运行成功的日志如下:

packageJobJar:[/tmp/hadoop-cp/hadoop-unjar2910356701799592623/] []/tmp/streamjob4550176904973722526.jar tmpDir=null

11/12/15 19:27:23 INFOmapred.FileInputFormat: Total input paths to process : 1

11/12/15 19:27:23 INFOstreaming.StreamJob: getLocalDirs(): [/tmp/hadoop-cp/mapred/local]

11/12/15 19:27:23 INFOstreaming.StreamJob: Running job: job_201112151707_0019

11/12/15 19:27:23 INFOstreaming.StreamJob: To kill this job, run:

11/12/15 19:27:23 INFOstreaming.StreamJob: /home//hadoop/bin/../bin/hadoop job -Dmapred.job.tracker=localhost:9001 -kill job_201112151707_0019

11/12/15 19:27:23 INFOstreaming.StreamJob: Tracking URL:http://localhost:50030/jobdetails.jsp?jobid=job_201112151707_0019

11/12/15 19:27:24 INFOstreaming.StreamJob: map 0% reduce 0%

11/12/15 19:27:34 INFOstreaming.StreamJob: map 100% reduce 0%

11/12/15 19:27:46 INFOstreaming.StreamJob: map 100% reduce 100%

11/12/15 19:27:49 INFOstreaming.StreamJob: Job complete: job_201112151707_0019

11/12/15 19:27:49 INFOstreaming.StreamJob: Output: output