Hive：JDBC示例

1)本地目录/home/hadoop/test下的test4.txt文件内容(每行数据之间用tab键隔开)如下所示:

[hadoop@master test]$ sudo vim test4.txt

    dajiangtai

    hadoop

    hive

    hbase

    spark

2)启动hiveserver2

[hadoop@master test]$ cd ${HIVE_HOME}/bin

[hadoop@master bin]$ ll

total

-rwxr-xr-x  hadoop hadoop  Jan   beeline

drwxr-xr-x  hadoop hadoop  May  : ext

-rwxr-xr-x  hadoop hadoop  Jan   hive

-rwxr-xr-x  hadoop hadoop  Jan   hive-config.sh

-rwxr-xr-x  hadoop hadoop  Jan   hiveserver2

-rwxr-xr-x  hadoop hadoop  Jan   metatool

-rwxr-xr-x  hadoop hadoop  Jan   schematool

[hadoop@master bin]$ ./hiveserver2

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/opt/modules/hadoop-2.6./share/hadoop/common/lib/slf4j-log4j12-1.7..jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/opt/modules/hive1.0.0/lib/hive-jdbc-1.0.-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

3) 程序代码

import java.sql.Connection;

import java.sql.DriverManager;

import java.sql.ResultSet;

import java.sql.SQLException;

import java.sql.Statement;

public class Hive {

    private static String driverName = "org.apache.hive.jdbc.HiveDriver";//hive驱动名称

    private static String url = "jdbc:hive2://master:10000/default";//连接hive2服务的连接地址，Hive0.11.0以上版本提供了一个全新的服务：HiveServer2

    private static String user = "hadoop";//对HDFS有操作权限的用户

    private static String password = "";//在非安全模式下，指定一个用户运行查询，忽略密码

    private static String sql = "";

    private static ResultSet res;

    public static void main(String[] args) {

        try {

            Class.forName(driverName);//加载HiveServer2驱动程序

            Connection conn = DriverManager.getConnection(url, user, password);//根据URL连接指定的数据库

            Statement stmt = conn.createStatement();

            //创建的表名

            String tableName = "testHiveDriverTable";

            /** 第一步:表存在就先删除 **/

            sql = "drop table " + tableName;

            stmt.execute(sql);

            /** 第二步:表不存在就创建 **/

            sql = "create table " + tableName + " (key int, value string)  row format delimited fields terminated by '\t' STORED AS TEXTFILE";

            stmt.execute(sql);

            // 执行“show tables”操作

            sql = "show tables '" + tableName + "'";

            res = stmt.executeQuery(sql);

            if (res.next()) {

                System.out.println(res.getString());

            }

            // 执行“describe table”操作

            sql = "describe " + tableName;

            res = stmt.executeQuery(sql);

            while (res.next()) {

                System.out.println(res.getString() + "\t" + res.getString());

            }

            // 执行“load data into table”操作

            String filepath = "/home/hadoop/test/test4.txt";//hive服务所在节点的本地文件路径

            sql = "load data local inpath '" + filepath + "' into table " + tableName;

            stmt.execute(sql);

            // 执行“select * query”操作

            sql = "select * from " + tableName;

            res = stmt.executeQuery(sql);

            while (res.next()) {

                System.out.println(res.getInt() + "\t" + res.getString());

            }

            // 执行“regular hive query”操作，此查询会转换为MapReduce程序来处理

            sql = "select count(*) from " + tableName;

            res = stmt.executeQuery(sql);

            while (res.next()) {

                System.out.println(res.getString());

            }

            conn.close();

            conn = null;

        } catch (ClassNotFoundException e) {

            e.printStackTrace();

            System.exit();

        } catch (SQLException e) {

            e.printStackTrace();

            System.exit();

        }

    }

}

4) 运行结果(右击-->Run as-->Run on Hadoop)

此时直接运行会报错，解决方案请见下一篇博文：HiveSQLException: Error while compiling statement: No privilege 'Create' found for outputs { database:default }。

运行日志如下：

-- ::, INFO [org.apache.hive.jdbc.Utils] - Supplied authorities: master:

-- ::, INFO [org.apache.hive.jdbc.Utils] - Resolved authority: master:

-- ::, INFO [org.apache.hive.jdbc.HiveConnection] - Will try to open client transport with JDBC Uri: jdbc:hive2://master:10000/default

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - opening transport org.apache.thrift.transport.TSaslClientTransport@3834d63f

-- ::, DEBUG [org.apache.thrift.transport.TSaslClientTransport] - Sending mechanism name PLAIN and initial response of length

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: Writing message with status START and payload length

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: Writing message with status COMPLETE and payload length

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: Start message handled

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: Main negotiation loop complete

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: SASL Client receiving last message

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: Received message with status COMPLETE and payload length

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.hive.jdbc.HiveQueryResultSet] - Fetched row string:

testhivedrivertable

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.hive.jdbc.HiveQueryResultSet] - Fetched row string:

key    int

-- ::, DEBUG [org.apache.hive.jdbc.HiveQueryResultSet] - Fetched row string:

value    string

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.hive.jdbc.HiveQueryResultSet] - Fetched row string:

1    dajiangtai

-- ::, DEBUG [org.apache.hive.jdbc.HiveQueryResultSet] - Fetched row string:

2    hadoop

-- ::, DEBUG [org.apache.hive.jdbc.HiveQueryResultSet] - Fetched row string:

3    hive

-- ::, DEBUG [org.apache.hive.jdbc.HiveQueryResultSet] - Fetched row string:

4    hbase

-- ::, DEBUG [org.apache.hive.jdbc.HiveQueryResultSet] - Fetched row string:

5    spark

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.hive.jdbc.HiveQueryResultSet] - Fetched row string: 

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - writing data length:

-- ::, DEBUG [org.apache.thrift.transport.TSaslTransport] - CLIENT: reading data length:

执行“show tables”运行结果:

testhivedrivertable

执行“describe table”运行结果:

key    int

value    string

执行“select * query”运行结果:

    dajiangtai

    hadoop

    hive

    hbase

    spark

或者从集群上查看运行结果。

hive> show tables;

OK

copy_student1

copy_student2

copy_student3

copy_student4

employee

group_gender_agg

group_gender_sum

group_test

index_test

index_tmp

partition_test

student1

student2

test

test_view

testhivedrivertable

user

Time taken: 0.153 seconds, Fetched:  row(s)

hive> desc testhivedrivertable;

OK

key                     int

value                   string

Time taken: 0.184 seconds, Fetched:  row(s)

hive> select * from testhivedrivertable;

OK

1    dajiangtai

2    hadoop

3    hive

4    hbase

5    spark

Time taken: 0.346 seconds, Fetched:  row(s)

以上就是博主为大家介绍的这一板块的主要内容，这都是博主自己的学习过程，希望能给大家带来一定的指导作用，有用的还望大家点个支持，如果对你没用也望包涵，有错误烦请指出。如有期待可关注博主以第一时间获取更新哦，谢谢！　

Hive：JDBC示例的更多相关文章

Hive和Jdbc示例
重要:在使用 JDBC 开发 Hive 程序时, 必须首先开启 Hive 的远程服务接口.使用下面命令进行开启:hive -service hiveserver & 1). 测试数据 user ...
三、hive JavaAPI示例
在上文中https://www.cnblogs.com/lay2017/p/9973370.html 我们通过hive shell去操作hive,本文我们以Java代码的示例去对hive执行加载数据和 ...
Hive JDBC——深入浅出学Hive
第一部分:搭建Hive JDBC开发环境搭建:Steps •新建工程hiveTest •导入Hive依赖的包 •Hive 命令行启动Thrift服务 •hive --service hiveser ...
Hive学习之六《Hive进阶— —hive jdbc》详解
接Hive学习五 http://www.cnblogs.com/invban/p/5331159.html 一.配置环境变量 hive jdbc的开发,在开发环境中,配置Java环境变量修改/etc ...
Hive 8、Hive2 beeline 和 Hive jdbc
1.Hive2 beeline Beeline 要与HiveServer2配合使用,支持嵌入模式和远程模式启动beeline 打开两个Shell窗口,一个启动Hive2 一个beeline连接hi ...
Hive JDBC:java.lang.RuntimeException: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): User: root is not allowed to impersonate anonymous
今天使用JDBC来操作Hive时,首先启动了hive远程服务模式:hiveserver2 &(表示后台运行),然后到eclipse中运行程序时出现错误: java.sql.SQLExcepti ...
使用Spring Boot操作Hive JDBC时，启动时报出错误：NoSuchMethodError: org.eclipse.jetty.servlet.ServletMapping.setDef
使用Spring Boot操作Hive JDBC时,启动时报出错误:NoSuchMethodError: org.eclipse.jetty.servlet.ServletMapping.setDef ...
hive JDBC异常到多租户
hive jdbc执行select count(*) from test报错. return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedT ...
Hive jdbc连接出现java.sql.SQLException: enabling autocommit is not supported
1.代码如下 String url = "jdbc:hive2://master135:10000/default"; String user = "root" ...

随机推荐

HDOJ1238(string)
Substrings Time Limit: 2000/1000 MS (Java/Others) Memory Limit: 65536/32768 K (Java/Others)Total ...
c++17 filesystem, regex 遍历目录
linux 遍历目录+文件(优化版本) c++17 FS 还是挺好用的, VS2017支持,但是linux g++7.3 还是不支持 filesystem #include<filesystem ...
Android中EditTex焦点设置和弹不弹出输入法的问题(转)
今天编程碰到了一个问题:有一款平板,打开一个有EditText的Activity会默认弹出输入法.为了解决这个问题就深入研究了下android中焦点Focus和弹出输入法的问题.在网上看了些例子都不够 ...
Python模块-logging模块(一)
logging模块用来写日志文件有5个级别,debug(),info(),warning(),error()和critical(),级别最高的为critical() debug()为调试模式,inf ...
VBS调用并监控记事本进程
Dim flag flag=true Set WshShell = CreateObject("WScript.Shell") '创建WScript.Shell对象 Set ...
使用python对文件夹里面所有代码行数进行统计。
统计目录下所有的代码个数和总行数. # -*- coding: utf-8 -*- # @Author : ydf import json import os from pathlib import ...
[bzoj3670] [NOI2014] [lg2375] 动物园
nxt数组为KMP的next数组num[i]储存了i前面可以匹配的串的个数.先在KMP求nxt中顺便求出num最后再找到对于i的最大的前后缀不重叠的可匹配的j,ans*=(num[j]+1)%1000 ...
#ifdef-#endif的作用及其使用技巧
电脑程序语句,我们可以用它区隔一些与特定头文件.程序库和其他文件版本有关的代码. 1 2 3 #ifdef语句1 //程序2 #endif 可翻译为:如果宏定义了语句1则程序2. 作用:我们可以用它区 ...
Servlet编程实例续3
----------------siwuxie095 Servlet 跳转之请求的转发修改 LoginServlet.java: package com.siwuxie095.servlet; im ...
项目一:第五天 1、区域数据（pinyin4j-简码，城市编码） 2、Web层代码重构（model对象，分页代码提取） 3、区域分页查询 3、分区添加功能 4、定区管理管理-添加，分页
Service: /** * @Description: 1.保存定区 2.让分区关联定区 * 对象三种状态 1.持久态(被session管理对象-一级缓存中有对象) 2.托管态(有OID标识,数据 ...

Hive：JDBC示例

Hive：JDBC示例的更多相关文章

随机推荐

热门专题