1、保证spark-sql已经使用mysql作为metadata存储介质2、启动thrift网关$SPARK_HOME/sbin/start-thriftserver.sh--driver-class-path
/usr/local/spark/spark-1.3.0-bin-hadoop2.3/lib/mysql-connector-java-5.1.6-bin.jar
--masterspark://hd1:7077--executor-memory2g--total-..
分类:
其他好文 时间:
2015-06-23 23:23:32
阅读次数:
888
1、生成python用的thrift模块thrift--genpy
/src/main/resources/org/apache/hadoop/hbase/thrift/Hbase.thrift(该路径是从hbase的源代码文件中来的)这样会在当前路径生成一个gen-py路径2、安装cdgen-py/hbasepython*.pybuildpython*.pyinstallcd..cp-rhbase/usr/lib/python2.6..
分类:
Web程序 时间:
2015-06-23 18:19:49
阅读次数:
249
Step1yuminstallautomakelibtoolflexbisonpkgconfiggcc-c++Step2curlftp://ftp.pbone.net/mirror/ftp5.gwdg.de/pub/opensuse/repositories/home:/monkeyiq:/centos6updates/CentOS_CentOS-6/noarch/autoconf-2.69-12.2.noarch.rpm>autoconf-2.69-12.2.noarch.rpmStep3yumins..
分类:
Web程序 时间:
2015-06-23 18:19:21
阅读次数:
161
#pythonfromthriftimportThriftfromthrift.transportimport
TSocketfromthrift.transportimportTTransportfromthrift.protocol
importTBinaryProtocolfromhbaseimportHbasefromhbase.ttypesimport*transport=TSocket.TSocket(‘192.168.137.101‘,9090)transport=TTransport.TBuf..
分类:
编程语言 时间:
2015-06-23 18:17:38
阅读次数:
150