Hive操作笔记v0.1.docx

Hive操作笔记Hive安装（1.2.1）解压一个hive安装包到集群的任意一台机器上配置hive的目录到环境变量中将hive的lib中的jline.2.12.jar 替换掉 hadoop2.6.4/share/hadoop/yarn/lib/jline.0.94.jar4、修改配置文件在hive的conf目录中vi hive-site.xmlconfigurationpropertynamejavax.jdo.option.ConnectionURL/namevaluejdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist=true/valuedescriptionJDBC connect string for a JDBC metastore/description/propertypropertynamejavax.jdo.option.ConnectionDriverName/namevaluecom.mysql.jdbc.Driver/valuedescriptionDriver class name for a JDBC metastore/description/propertypropertynamejavax.jdo.option.ConnectionUserName/namevalueroot/valuedescriptionusername to use against metastore database/description/propertypropertynamejavax.jdo.option.ConnectionPassword/namevalueroot/valuedescriptionpassword to use against metastore database/description/property/configuration数据库前提1、远程连接mysql权限被拒绝时，先在mysql服务器上用客户端连上，然后敲如下命令：grant all privileges on *.* to ‘root’@’%’ identified by ‘root的密码’ with grant option;flush privileges;数据库的排序规则必须为latin13、在hive的lib中放置一个mysql的jdbc驱动jar包5、启动hive注意：先保证你的hdfs和yarn正常运行，hadoop已配置在环境变量中否则：Cannot find hadoop installation: $HADOOP_HOME or $HADOOP_PREFIX must be set or hadoop must be in the path启动命令： bin/hive测试：show databases;show tables;新版本(0.12.0 以上)中需要增加以下配置propertynamehive.querylog.location/namevalue/home/crxy/deployed-soft/hive-0.14.0/tmp/value/propertypropertynamehive.exec.local.scratchdir/namevalue/home/crxy/deployed-soft/hive-0.14.0/tmp/value/propertypropertynamehive.downloaded.resources.dir/namevalue/home/crxy/deployed-soft/hive-0.14.0/tmp/value/propertyLinux下Mysql数据库2.1安装1删除原本依赖rpm -e --nodeps `rpm -qa |grep MySQL`2然后yum在线安装 yum install -y mysql-server3启动mysql服务sudo service mysqld start4初始化配置mysql_secure_installation5加入到开机启动项chkconfig mysqld on6权限授予grant all privileges on *.* to root@% identified by root;flush privileges;2.2hive乱码问题修改hive mysql元数据库的以下编码即可：-- 修改表字段和表COMMENT ALTER TABLE COLUMNS_V2 MODIFY COLUMN COMMENT VARCHAR(256) CHARACTER SET utf8;ALTER TABLE TABLE_PARAMS MODIFY COLUMN