读书人

hadoop dfs的小技艺

发布时间: 2012-07-23 09:42:19 作者: rapoo

hadoop dfs的小技巧

在测试hadoop的dfs的各种命令的时候,突然发现dfs -rmr支持通配符操作(前提是要在hadoop的bin目录下执行)

补充点:ls cat也支持通配符的

?

例如执行ls后有如下文件

?

Python代码??hadoop dfs的小技艺
  1. [dikar@dikar?~]$?hadoop?dfs?-ls??
  2. opts=??-Dhadoop.log.dir=/home/dikar/Program/hadoop-0.20.2/bin/../logs?-Dhadoop.log.file=hadoop.log?-Dhadoop.home.dir=/home/dikar/Program/hadoop-0.20.2/bin/..?-Dhadoop.id.str=?-Dhadoop.root.logger=INFO,console?-Djava.library.path=/home/dikar/Program/hadoop-0.20.2/bin/../lib/native/Linux-i386-32?-Dhadoop.policy.file=hadoop-policy.xml??
  3. class=org.apache.hadoop.fs.FsShell??
  4. params=-ls??
  5. Found?3?items??
  6. -rw-r--r--???2?dikar?supergroup????????622?2011-03-05?16:55?/user/dikar/ta??
  7. -rw-r--r--???2?dikar?supergroup??????????9?2011-03-05?16:51?/user/dikar/test1??
  8. -rw-r--r--???2?dikar?supergroup?????????10?2011-03-05?16:51?/user/dikar/test2??

?然后执行rmr test*

?

Python代码??hadoop dfs的小技艺
  1. [dikar@dikar?bin]$?hadoop?dfs?-rmr?test*??
  2. opts=??-Dhadoop.log.dir=/home/dikar/Program/hadoop-0.20.2/bin/../logs?-Dhadoop.log.file=hadoop.log?-Dhadoop.home.dir=/home/dikar/Program/hadoop-0.20.2/bin/..?-Dhadoop.id.str=?-Dhadoop.root.logger=INFO,console?-Djava.library.path=/home/dikar/Program/hadoop-0.20.2/bin/../lib/native/Linux-i386-32?-Dhadoop.policy.file=hadoop-policy.xml??
  3. class=org.apache.hadoop.fs.FsShell??
  4. params=-rmr?test*??
  5. Deleted?hdfs://dikar:54310/user/dikar/test1??
  6. Deleted?hdfs://dikar:54310/user/dikar/test2??

?在用ls 查看

?

Python代码??hadoop dfs的小技艺
  1. [dikar@dikar?bin]$?hadoop?dfs?-ls??
  2. opts=??-Dhadoop.log.dir=/home/dikar/Program/hadoop-0.20.2/bin/../logs?-Dhadoop.log.file=hadoop.log?-Dhadoop.home.dir=/home/dikar/Program/hadoop-0.20.2/bin/..?-Dhadoop.id.str=?-Dhadoop.root.logger=INFO,console?-Djava.library.path=/home/dikar/Program/hadoop-0.20.2/bin/../lib/native/Linux-i386-32?-Dhadoop.policy.file=hadoop-policy.xml??
  3. class=org.apache.hadoop.fs.FsShell??
  4. params=-ls??
  5. Found?1?items??
  6. -rw-r--r--???2?dikar?supergroup????????622?2011-03-05?16:59?/user/dikar/ta??

?更多信息请查看?java进阶网?http://www.javady.com

读书人网 >开源软件

热点推荐