码迷,mamicode.com
首页 > 其他好文 > 详细

【原】centos6.5下cdh4.6 Oozie安装

时间:2014-05-09 15:42:15      阅读:580      评论:0      收藏:0      [点我收藏+]

标签:style   blog   class   code   java   tar   

0、oozie只需安装在一台服务器上,这里选择在namenode上来安装;安装用户为cloud-user

1、安装Oozie包:

   sudo yum install -y oozie oozie-client
2、对于yarn来说,需要修改/etc/oozie/conf/oozie-env.sh中:
   CATALINA_BASE=/usr/lib/oozie/oozie-server
3、配置mysql:
   yum install -y mysql-server
   创建数据库:
   mysql -u root -p
   mysql> create database oozie;
   mysql> grant all privileges on oozie.* to ‘oozie‘@‘localhost‘ identified by ‘oozie‘;
   mysql> grant all privileges on oozie.* to ‘oozie‘@‘%‘ identified by ‘oozie‘;
   mysql> exit
4、配置oozie-site.xml:
bubuko.com,布布扣
 1 <property>
 2      <name>oozie.service.JPAService.jdbc.driver</name>
 3      <value>com.mysql.jdbc.Driver</value>
 4 </property>
 5 <property>
 6      <name>oozie.service.JPAService.jdbc.url</name>
 7      <value>jdbc:mysql://10.0.0.2:3306/oozie</value>
 8 </property>
 9 <property>
10      <name>oozie.service.JPAService.jdbc.username</name>
11      <value>oozie</value>
12 </property>
13 <property>
14      <name>oozie.service.JPAService.jdbc.password</name>
15      <value>oozie</value>
16 </property>
17 <property>
18      <name>oozie.action.mapreduce.uber.jar.enable</name>
19      <value>true</value>
20 </property>
21 <property>
22      <name>oozie.service.HadoopAccessorService.supported.filesystems</name>
23      <value>hdfs,viewfs</value>
24 </property>
25   <property>
26      <name>oozie.service.ProxyUserService.proxyuser.cloud-user.hosts</name>
27      <value>*</value>
28 </property>
29  <property>
30      <name>oozie.service.ProxyUserService.proxyuser.cloud-user.groups</name>
31      <value>*</value>
32 </property>
bubuko.com,布布扣
5、拷贝JDBC Driver:
    sudo cp /usr/share/java/mysql-connector-java.jar /var/lib/oozie
    sudo cp /usr/lib/hadoop/lib/hadoop-lzo-cdh4-0.4.15-gplextras.jar /var/lib/oozie
    sudo cp /usr/lib/hadoop/lib/hadoop-lzo.jar /var/lib/oozie
6、创建oozie 数据库scheme,这一步骤需要root来执行:
    su -
  /usr/lib/oozie/bin/ooziedb.sh create -sqlfile oozie-create.sql
    /usr/lib/oozie/bin/ooziedb.sh create -run  
7、使能web console:
  sudo mv ext-2.2.zip /var/lib/oozie/
    cd /var/lib/oozie/ && sudo unzip ext-2.2.zip
  sudo chown -R oozie:oozie /var/lib/oozie/
8、安装Oozie ShareLib:
    sudo -u hdfs hadoop fs -mkdir /user/oozie
    sudo -u hdfs hadoop fs -chown oozie:oozie /user/oozie
    mkdir /tmp/ooziesharelib
    cd /tmp/ooziesharelib
    tar xzf /usr/lib/oozie/oozie-sharelib-yarn.tar.gz
    sudo -u oozie hadoop fs -put share /user/oozie/share
9、启动服务:
    sudo service oozie start
10、测试map-reduce:
  添加/etc/hadoop/conf/core-site.xml
bubuko.com,布布扣
1 <property> 
2    <name>hadoop.proxyuser.oozie.hosts</name> 
3    <value>10.0.0.2</value> 
4 </property> 
5 <property> 
6    <name>hadoop.proxyuser.oozie.groups</name> 
7    <value>*</value> 
8 </property> 
bubuko.com,布布扣
  cp /usr/share/doc/oozie-3.3.2+100/oozie-examples.tar.gz .  
  tar -zxvf oozie-examples.tar.gz
  修改example/apps/map-reduce/job.properties 

  nameNode=hdfs://10.0.0.2:8020
  jobTracker=10.0.0.2:8032 端口改为/etc/hadoop/conf/yarn-site.xml中 ‘yarn.resourcemanager.address ‘ 项的值

    hadoop fs -put examples
  oozie job -oozie http://10.0.0.3:11000/oozie -config  ./examples/apps/no-op/job.properties -run
  Job ID : 0000000-140508214215146-oozie-oozi-W
  通过oozie job -oozie http://10.0.0.3:11000/oozie -log 0000000-140508214215146-oozie-oozi-W查看log
  通过oozie job -oozie http://10.0.0.3:11000/oozie -info 0000000-140508214215146-oozie-oozi-W查看信息
  通过http://namenode:11000/oozie查看web console

【原】centos6.5下cdh4.6 Oozie安装,布布扣,bubuko.com

【原】centos6.5下cdh4.6 Oozie安装

标签:style   blog   class   code   java   tar   

原文地址:http://www.cnblogs.com/yuandianliws/p/3718215.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!