普开数据大数据课程之基础hadoop命令讲解.docxVIP

普开数据大数据课程之基本hadoop命令讲解环境配置介绍公司目前Intel Haoop 的测试环境如下：NameNode : 192.168.6.167DataNode : 192.168.6.168 ; 192.168.6.169后台登录用户名密码：用户名： root密码：hadoophadoop登录过程可以通过 SecureCRT工具登录通过ssh2登录方式登录设置自动登录的用户名和密码等命令运行测试本部分只讲查找命令使用的帮助的方法，具体命令只做少量举例。通过SecureCRT 的ssh2方式登录到 namenode、datanode中的任何一个在命令提示符下输入命令，格式如下：hadoop fs –ls hdfs://192.168.6.167:8020/hadoop fs –ls hdfs://192.168.6.167/192.168.6.167 为NameNode 所在的机器IP。见上图，192.168.6.167 保存者 HDFS分布式文件系统的元数据，只有该NameNode保存着相应的文件系统的信息。之所以要写成hdfs://192.168.6.167:8020/这种样式，是因为192.168.6.167为NameNode节点的IP，并且解释文件系统 hdfs的后台进程的端口号是 8020。等价的简化命令为hadoop fs -ls /Hadoop 文件操作方面的命令hadoop fs –helphadoop fs [-fs local | file system URI] [-conf configuration file] [-D property=value] [-ls path] [-lsr path] [-du path] [-dus path] [-mv src dst] [-cp src dst] [-rm [-skipTrash] src] [-rmr [-skipTrash] src] [-put localsrc ... dst] [-copyFromLocal localsrc ... dst] [-moveFromLocal localsrc ... dst] [-get [-ignoreCrc] [-crc] src localdst [-getmerge src localdst [addnl]] [-cat src] [-copyToLocal [-ignoreCrc] [-crc] src localdst] [-moveToLocal src localdst] [-mkdir path] [-report] [-setrep [-R] [-w] rep path/file] [-touchz path] [-test -[ezd] path] [-stat [format] path] [-tail [-f] path] [-text path] [-chmod [-R] MODE[,MODE]... | OCTALMODE PATH...] [-chown [-R] [OWNER][:[GROUP]] PATH...] [-chgrp [-R] GROUP PATH...] [-count[-q] path] [-help [cmd]]Hadoop HDFS管理方面的命令hadoop dfsadmin –helphadoop dfsadmin [-report] [-safemode enter | leave | get | wait] [-saveNamespace] [-refreshNodes] [-decommissionNodes node-list] [-recommissionNodes node-list] [-setQuota quota dirname...dirname] [-clrQuota dirname...dirname] [-setSpaceQuota quota dirname...dirname] [-clrSpaceQuota dirname...dirname] [-refreshServiceAcl] [-refreshUserToGroupsMappings] [refreshSuperUserGroupsConfiguration] [-setBalancerBand