hive创建表带中文注释报错解决方法

hive创建带有中文注释的表报错；

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:javax.jdo.JDODataStoreException: Transaction failed to commit

        at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:451)

        at org.datanucleus.api.jdo.JDOTransaction.rollback(JDOTransaction.java:186)

        at org.apache.hadoop.hive.metastore.ObjectStore.rollbackTransaction(ObjectStore.java:444)

        at org.apache.hadoop.hive.metastore.ObjectStore.createTable(ObjectStore.java:746)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:108)

        at com.sun.proxy.$Proxy0.createTable(Unknown Source)

        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1270)

        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:1303)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:106)

        at com.sun.proxy.$Proxy12.create_table_with_environment_context(Unknown Source)

        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:8016)

        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:8000)

        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)

        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)

        at org.apache.hadoop.hive.metastore.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:48)

        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:244)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:745)

NestedThrowablesStackTrace:

Exception thrown flushing changes to datastore

org.datanucleus.exceptions.NucleusDataStoreException: Exception thrown flushing changes to datastore

        at org.datanucleus.store.rdbms.SQLController$1.transactionFlushed(SQLController.java:708)

        at org.datanucleus.store.connection.AbstractManagedConnection.transactionFlushed(AbstractManagedConnection.java:86)

        at org.datanucleus.store.connection.ConnectionManagerImpl$2.transactionFlushed(ConnectionManagerImpl.java:454)

        at org.datanucleus.TransactionImpl.flush(TransactionImpl.java:203)

        at org.datanucleus.TransactionImpl.rollback(TransactionImpl.java:420)

        at org.datanucleus.api.jdo.JDOTransaction.rollback(JDOTransaction.java:182)

        at org.apache.hadoop.hive.metastore.ObjectStore.rollbackTransaction(ObjectStore.java:444)

        at org.apache.hadoop.hive.metastore.ObjectStore.createTable(ObjectStore.java:746)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:108)

        at com.sun.proxy.$Proxy0.createTable(Unknown Source)

        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1270)

        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:1303)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:106)

        at com.sun.proxy.$Proxy12.create_table_with_environment_context(Unknown Source)

        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:8016)

        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:8000)

        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)

        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)

        at org.apache.hadoop.hive.metastore.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:48)

        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:244)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:745)

Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after statement closed.

        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)

        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)

        at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)

        at com.mysql.jdbc.Util.getInstance(Util.java:386)

        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)

        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)

        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)

        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)

        at com.mysql.jdbc.StatementImpl.checkClosed(StatementImpl.java:447)

        at com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1411)

        at com.jolbox.bonecp.StatementHandle.executeBatch(StatementHandle.java:424)

        at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeBatch(ParamLoggingPreparedStatement.java:372)

        at org.datanucleus.store.rdbms.SQLController.processConnectionStatement(SQLController.java:628)

        at org.datanucleus.store.rdbms.SQLController.processStatementsForConnection(SQLController.java:596)

        at org.datanucleus.store.rdbms.SQLController$1.transactionFlushed(SQLController.java:683)

        ... 30 more

Nested Throwables StackTrace:

character_set_database 需要设置成“latin1”

修改数据库编码：

mysql> set  character_set_database =latin1;

Query OK, 0 rows affected (0.00 sec)

mysql> show variables like '%char%';

+--------------------------+----------------------------+

| Variable_name            | Value                      |

+--------------------------+----------------------------+

| character_set_client     | utf8                       |

| character_set_connection | utf8                       |

| character_set_database   | latin1                     |

| character_set_filesystem | binary                     |

| character_set_results    | utf8                       |

| character_set_server     | utf8                       |

| character_set_system     | utf8                       |

| character_sets_dir       | /usr/share/mysql/charsets/ |

+--------------------------+----------------------------+

8 rows in set (0.00 sec)

为了支持Hive建表时插入中文注释需要在MySQL中做如下设置：

use hive;

//修改字段注释字符集
alter table COLUMNS_V2 modify column COMMENT varchar(256) character set utf8;
//修改表注释字符集
alter table TABLE_PARAMS modify column PARAM_VALUE varchar(4000) character set utf8;
//修改分区注释字符集
alter table PARTITION_KEYS modify column PKEY_COMMENT varchar(4000) character set utf8;

再次执行建表语句，成功！！！

hive> create table page_view

    > (

    > page_id bigint comment '页面ID',

    > page_name string comment '页面名称',

    > page_url string comment '页面URL'

    > )

    > comment '页面视图'

    > partitioned by (ds string comment '当前时间，用于分区字段')

    > row format delimited

    > stored as rcfile

    > location '/user/hive/test';

OK

Time taken: 0.493 seconds

hive> show tables;

OK

page_view

Time taken: 0.057 seconds, Fetched: 1 row(s)

hive> desc page_view;

OK

page_id                 bigint                  页面ID

page_name               string                  页面名称

page_url                string                  页面URL

ds                      string                  当前时间，用于分区字段         

# Partition Information

# col_name              data_type               comment             

ds                      string                  当前时间，用于分区字段

Time taken: 0.19 seconds, Fetched: 9 row(s)

参考：http://blog.csdn.net/levy_cui/article/details/51646145

hive创建表带中文注释报错解决方法的更多相关文章

Python 中文注释报错解决方法
代码中一旦有了中文注释便会报错. 原因如果文件里有非ASCII字符,需要在第一行或第二行指定编码声明. 解决方法在第一行或是第二行加入这么一句# -- coding: utf-8 -- 完美解决
sass注释中有中文出现报错解决方法
在使用koala编译sass成css过程中出现这样的报错后来查资料说是自己在sass中的注释中有中文引起的, 解决方案: 进入C:\Ruby25-x64\lib\ruby\gems\2.5.0\ge ...
python运用中文注释时报错解决方法
写了一段简单的代码,不知为什么总是报错,后来上网查了一下才知道原因,当用中文进行注释时需要添加如下代码:# coding=utf-8 (注意:该段代码必须放在最前面才能有用,并且 ...
Python中文注释报错的解决方法
在Python的程序中加了中文注释会报错解决方法是:在程序的最开始位置加入 # -- coding: utf-8 --
iOS url带中文下载时报错解决方法
问题描述:下载文件时, 请求带中文的URL的资源时,比如:http://s237.sznews.com/pic/2010/11/23/e4fa5794926548ac953a8a525a23b6f2/ ...
eclipse创建的maven项目，pom.xml文件报错解决方法
[错误一:]maven 编译级别过低 [解决办法:] 使用 maven-compiler-plugin 将 maven 编译级别改为 jdk1.6 以上:  ...
create-react-app创建项目后，运行npm run eject报错解决方法
运行npm run eject报错解决方法主要问题是脚手架添加.gitgnore文件,但是却没有本地仓库,使用以下命令操作以下就可以了 git init git add . git commit - ...
MyEclipse Server view报错解决方法
MyEclipse Server view报错解决方法方法/步骤启动MyEclipse,弹出一个框,报错. ---------------------------------------- ...
Loadrunner参数化逗号报错解决方法
Loadrunner参数化逗号报错解决方法介绍Loadrunner参数化时,参数中包含有逗号时出错的解决方法. 在Loadrunner进行参数化时,参数中如果含有逗号,编辑保存后会报错: 此 ...

随机推荐

TypeScript学习笔记（四）：函数
这篇笔记我们来看看TypeScript中的函数. 函数类型在JavaScript中存在两种定义函数的方法,如下: //命名函数 function add(x, y) { return x+y; } ...
ecshop以幻灯版调用首页主广告显示
默认的是index_ad.lbi模板有一个$flash变量了,但在搜索搜索没发现  <l ...
radio select的 option使用
1 radio的使用 <td id="sex">性别: <input type="radio" name=&quo ...
javascript --执行上下文,作用域
执行上下文顾名思意就知道他是动态的,只在代码运行的时候产生作用域顾名思意就知道它是一个"领域",并且这个"领域"在一开始就规划好, 不会在改, var d ...
ssh 设置免password登录
如果: 实现->操作机A机要以用户"user1"身份.免password登录B机和C机? B机和C机建立用户 user1 而且能够ssh 登录. A机设置: 1.安装ss ...
权限执行[Android开发常见问题-4] RunTime.exec()如何以root权限执行多条指令？
每日一贴,今天的内容关键字为权限执行 RunTime.exec()这个接口可以说是给我们开发者供给了一个很好的直观操纵底层操纵系统的机遇,但是这个接口的使用还有很多需要注意的问题.由于要完全的分析这个 ...
Android应用开发多语言drawable目录
Android程序多语言的支持是就该Value目录不同国家的区分,前面文档有介绍相相应的国家名称Value怎样写例如以下说下多语言图片的替换也是就该图片目录目录drawable目录例如以下: Bac ...
Codeforces Gym 100523K K - Cross Spider 计算几何，判断是否n点共面
K - Cross SpiderTime Limit: 20 Sec Memory Limit: 256 MB 题目连接 http://acm.hust.edu.cn/vjudge/contest/v ...
Linux设备模型分析之kset（基于3.10.1内核）
作者:刘昊昱博客:http://blog.csdn.net/liuhaoyutz 内核版本:3.10.1 一.kset结构定义 kset结构体定义在include/linux/kobject.h ...
HomeSnap
http://arnauddegiuli.github.io/HomeSnap/ OnBufferingUpdateListener https://github.com/LuckyJayce/Mat ...

hive创建表带中文注释报错解决方法

hive创建表带中文注释报错解决方法的更多相关文章

随机推荐

热门专题