码迷,mamicode.com
首页 > 其他好文 > 详细

hive环境搭建

时间:2017-09-09 10:50:08      阅读:195      评论:0      收藏:0      [点我收藏+]

标签:环境变量   用户   dir   source   启动   key   ast   目录   nbsp   

机器规划:

 

主机 ip 进程
master1 10.112.29.9 hive server
master2 10.112.29.10 hive client

mysql安装:略

添加hive用户名,及数据库。mysql -uhive -h10.112.28.179 -phive123456

hive使用2.3.0版本:

wget http://mirror.bit.edu.cn/apache/hive/hive-2.3.0/apache-hive-2.3.0-bin.tar.gz

添加环境变量:

export HIVE_HOME=/letv/soft/apache-hive-2.3.0-bin
export HIVE_CONF_DIR=$HIVE_HOME/conf
export PATH=\$PATH:\$HIVE_HOME/bin

 

同步至master2,并 source /etc/profile

 

解压:  

tar zxvf apache-hive-2.3.0-bin.tar.gz

  

生成keytab:

addprinc -randkey hive/master1@JENKIN.COM
addprinc -randkey hive/master2@JENKIN.COM

xst -k /var/kerberos/krb5kdc/keytab/hive.keytab hive/master1@JENKIN.COM
xst -k /var/kerberos/krb5kdc/keytab/hive.keytab hive/master2@JENKIN.COM

  

拷贝至master2

scp /var/kerberos/krb5kdc/keytab/hive.keytab master2:/var/kerberos/krb5kdc/keytab/

  

增加hive-site.xml:

vim conf/hive-site.xml 

<configuration>
    <property>
            <name>javax.jdo.option.ConnectionURL</name>
            <value>jdbc:mysql://10.112.28.179:3306/hive?createDatabaseIfNotExist=true</value>
            <description>JDBC connect string for a JDBC metastore</description>
    </property>
    <property>
            <name>javax.jdo.option.ConnectionDriverName</name>
            <value>com.mysql.jdbc.Driver</value>
            <description>Driver class name for a JDBC metastore</description>
    </property>

    <property>
            <name>javax.jdo.option.ConnectionUserName</name>
            <value>hive<value>
            <description>username to use against metastore database</description>
    </property>
    <property>
            <name>javax.jdo.option.ConnectionPassword</name>
            <value>hive</value>
            <description>password to use against metastore database</description>
    </property>
</configuration>

 

hadoop core-site.xml增加配置:

<!-- hive congfig  -->
        <property>
                <name>hadoop.proxyuser.hive.hosts</name>
                <value>*</value>
        </property>
        <property>
                <name>hadoop.proxyuser.hive.groups</name>
                <value>*</value>
        </property>
        <property>
                <name>hadoop.proxyuser.hdfs.hosts</name>
                <value>*</value>
        </property>
        <property>
                <name>hadoop.proxyuser.hdfs.groups</name>
                <value>*</value>
        </property>
        <property>
                <name>hadoop.proxyuser.HTTP.hosts</name>
                <value>*</value>
        </property>
        <property>
                <name>hadoop.proxyuser.HTTP.groups</name>
                <value>*</value>
         </property>

  同步是其他机器。

scp etc/hadoop/core-site.xml master2:/xxx/soft/hadoop-2.7.3/etc/hadoop/
scp etc/hadoop/core-site.xml slave2:/xxx/soft/hadoop-2.7.3/etc/hadoop/

  

JDBC下载:

wget https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.44.tar.gz
tar zxvf mysql-connector-java-5.1.44.tar.gz 

 

复制到hive lib目录:

cp mysql-connector-java-5.1.44/mysql-connector-java-5.1.44-bin.jar apache-hive-2.3.0-bin/lib/

 

客户端配置:

将hive拷贝至master2

scp -r apache-hive-2.3.0-bin/ master2:/xxx/soft/

  

在master2上:

vim conf/hive-site.xml 

<configuration>
    <property>
        <name>hive.metastore.uris</name>
        <value>thrift://master1:9083</value>
    </property>
</configuration>

  

启动hive:

初始化数据:

./bin/schematool -dbType mysql -initSchema

 

获取票据:

kinit -k -t /var/kerberos/krb5kdc/keytab/hive.keytab hive/master1@JENKIN.COM

启动server:

hive --service metastore &

  

 

  

  

hive环境搭建

标签:环境变量   用户   dir   source   启动   key   ast   目录   nbsp   

原文地址:http://www.cnblogs.com/kisf/p/7497261.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!