在IDEA上用python来连接集群上的hive

1.在使用Python连接hive之前需要将hive中的文件拷贝到自己创建python项目中

cp -r apache-hive-0.14.-bin/lib/py  /home/jia/Desktop

2.把hive上的py目录下载到桌面之后，进入py目录，复制里面所有的文件到你创建的python项目下

3.新建一个myHiveLink.py文件，访问hive的代码如下

import sys
from hive_service import ThriftHive
from hive_service.ttypes import HiveServerException
from thrift import Thrift
from thrift.transport import TSocket
from thrift.transport import TTransport
from thrift.protocol import TBinaryProtocol

def hiveExe(sql):
    try:
        transport = TSocket.TSocket('121.8.xxx.xx', )
        transport = TTransport.TBufferedTransport(transport)
        protocol = TBinaryProtocol.TBinaryProtocol(transport)
        client = ThriftHive.Client(protocol)
        transport.open()

        client.execute(sql)

        print "The return value is : "
        resultSets=client.fetchAll()
        for j in range(len(resultSets)):
            print resultSets[j]
        print "............"
        transport.close()
    except Thrift.TException, tx:
        print '%s' % (tx.message)

        return resultSets

if __name__ == '__main__':
    hiveExe("select * from tableName limit 10")

4.访问结果如下：

/usr/bin/python2. /home/sendi/IdeaProjects/hive_python/.idea/HiveLink/myHiveLink.py
The return value is :
    1333280xxxx                    NULL    113.4092361    23.1117361
    1812682xxxx                        113.39436    23.42839
    1532152xxxx                        113.34354    23.28444
    1537219xxxx                       113.3470139    23.2713194
    1532570xxxx                       113.3468056    23.3133333
    1533673xxxx                       113.359375    23.2908333
    1530011xxxx                       113.3260417    23.2946528
    1532152xxxx                        113.3470139    23.2713194
    1895716xxxx                        113.35415    23.30307
    1534570xxxx                       113.3470139    23.2713194    

5.如果访问不了，可能是没有启动hive，服务，则进入hive的bin目录启动服务

hive --service hiveserver &