hive创建表带中文注释报错解决方法

hive创建带有中文注释的表报错；

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:javax.jdo.JDODataStoreException: Transaction failed to commit

        at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:451)

        at org.datanucleus.api.jdo.JDOTransaction.rollback(JDOTransaction.java:186)

        at org.apache.hadoop.hive.metastore.ObjectStore.rollbackTransaction(ObjectStore.java:444)

        at org.apache.hadoop.hive.metastore.ObjectStore.createTable(ObjectStore.java:746)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:108)

        at com.sun.proxy.$Proxy0.createTable(Unknown Source)

        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1270)

        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:1303)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:106)

        at com.sun.proxy.$Proxy12.create_table_with_environment_context(Unknown Source)

        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:8016)

        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:8000)

        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)

        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)

        at org.apache.hadoop.hive.metastore.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:48)

        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:244)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:745)

NestedThrowablesStackTrace:

Exception thrown flushing changes to datastore

org.datanucleus.exceptions.NucleusDataStoreException: Exception thrown flushing changes to datastore

        at org.datanucleus.store.rdbms.SQLController$1.transactionFlushed(SQLController.java:708)

        at org.datanucleus.store.connection.AbstractManagedConnection.transactionFlushed(AbstractManagedConnection.java:86)

        at org.datanucleus.store.connection.ConnectionManagerImpl$2.transactionFlushed(ConnectionManagerImpl.java:454)

        at org.datanucleus.TransactionImpl.flush(TransactionImpl.java:203)

        at org.datanucleus.TransactionImpl.rollback(TransactionImpl.java:420)

        at org.datanucleus.api.jdo.JDOTransaction.rollback(JDOTransaction.java:182)

        at org.apache.hadoop.hive.metastore.ObjectStore.rollbackTransaction(ObjectStore.java:444)

        at org.apache.hadoop.hive.metastore.ObjectStore.createTable(ObjectStore.java:746)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:108)

        at com.sun.proxy.$Proxy0.createTable(Unknown Source)

        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1270)

        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:1303)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:106)

        at com.sun.proxy.$Proxy12.create_table_with_environment_context(Unknown Source)

        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:8016)

        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:8000)

        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)

        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)

        at org.apache.hadoop.hive.metastore.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:48)

        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:244)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:745)

Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after statement closed.

        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)

        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)

        at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)

        at com.mysql.jdbc.Util.getInstance(Util.java:386)

        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)

        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)

        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)

        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)

        at com.mysql.jdbc.StatementImpl.checkClosed(StatementImpl.java:447)

        at com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1411)

        at com.jolbox.bonecp.StatementHandle.executeBatch(StatementHandle.java:424)

        at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeBatch(ParamLoggingPreparedStatement.java:372)

        at org.datanucleus.store.rdbms.SQLController.processConnectionStatement(SQLController.java:628)

        at org.datanucleus.store.rdbms.SQLController.processStatementsForConnection(SQLController.java:596)

        at org.datanucleus.store.rdbms.SQLController$1.transactionFlushed(SQLController.java:683)

        ... 30 more

Nested Throwables StackTrace:

character_set_database 需要设置成“latin1”

修改数据库编码：

mysql> set  character_set_database =latin1;

Query OK, 0 rows affected (0.00 sec)

mysql> show variables like '%char%';

+--------------------------+----------------------------+

| Variable_name            | Value                      |

+--------------------------+----------------------------+

| character_set_client     | utf8                       |

| character_set_connection | utf8                       |

| character_set_database   | latin1                     |

| character_set_filesystem | binary                     |

| character_set_results    | utf8                       |

| character_set_server     | utf8                       |

| character_set_system     | utf8                       |

| character_sets_dir       | /usr/share/mysql/charsets/ |

+--------------------------+----------------------------+

8 rows in set (0.00 sec)

为了支持Hive建表时插入中文注释需要在MySQL中做如下设置：

use hive;

//修改字段注释字符集
alter table COLUMNS_V2 modify column COMMENT varchar(256) character set utf8;
//修改表注释字符集
alter table TABLE_PARAMS modify column PARAM_VALUE varchar(4000) character set utf8;
//修改分区注释字符集
alter table PARTITION_KEYS modify column PKEY_COMMENT varchar(4000) character set utf8;

再次执行建表语句，成功！！！

hive> create table page_view

    > (

    > page_id bigint comment '页面ID',

    > page_name string comment '页面名称',

    > page_url string comment '页面URL'

    > )

    > comment '页面视图'

    > partitioned by (ds string comment '当前时间，用于分区字段')

    > row format delimited

    > stored as rcfile

    > location '/user/hive/test';

OK

Time taken: 0.493 seconds

hive> show tables;

OK

page_view

Time taken: 0.057 seconds, Fetched: 1 row(s)

hive> desc page_view;

OK

page_id                 bigint                  页面ID

page_name               string                  页面名称

page_url                string                  页面URL

ds                      string                  当前时间，用于分区字段         

# Partition Information

# col_name              data_type               comment             

ds                      string                  当前时间，用于分区字段

Time taken: 0.19 seconds, Fetched: 9 row(s)

参考：http://blog.csdn.net/levy_cui/article/details/51646145

hive创建表带中文注释报错解决方法的更多相关文章

Python 中文注释报错解决方法
代码中一旦有了中文注释便会报错. 原因如果文件里有非ASCII字符,需要在第一行或第二行指定编码声明. 解决方法在第一行或是第二行加入这么一句# -- coding: utf-8 -- 完美解决
sass注释中有中文出现报错解决方法
在使用koala编译sass成css过程中出现这样的报错后来查资料说是自己在sass中的注释中有中文引起的, 解决方案: 进入C:\Ruby25-x64\lib\ruby\gems\2.5.0\ge ...
python运用中文注释时报错解决方法
写了一段简单的代码,不知为什么总是报错,后来上网查了一下才知道原因,当用中文进行注释时需要添加如下代码:# coding=utf-8 (注意:该段代码必须放在最前面才能有用,并且 ...
Python中文注释报错的解决方法
在Python的程序中加了中文注释会报错解决方法是:在程序的最开始位置加入 # -- coding: utf-8 --
iOS url带中文下载时报错解决方法
问题描述:下载文件时, 请求带中文的URL的资源时,比如:http://s237.sznews.com/pic/2010/11/23/e4fa5794926548ac953a8a525a23b6f2/ ...
eclipse创建的maven项目，pom.xml文件报错解决方法
[错误一:]maven 编译级别过低 [解决办法:] 使用 maven-compiler-plugin 将 maven 编译级别改为 jdk1.6 以上:  ...
create-react-app创建项目后，运行npm run eject报错解决方法
运行npm run eject报错解决方法主要问题是脚手架添加.gitgnore文件,但是却没有本地仓库,使用以下命令操作以下就可以了 git init git add . git commit - ...
MyEclipse Server view报错解决方法
MyEclipse Server view报错解决方法方法/步骤启动MyEclipse,弹出一个框,报错. ---------------------------------------- ...
Loadrunner参数化逗号报错解决方法
Loadrunner参数化逗号报错解决方法介绍Loadrunner参数化时,参数中包含有逗号时出错的解决方法. 在Loadrunner进行参数化时,参数中如果含有逗号,编辑保存后会报错: 此 ...

随机推荐

Ecshop 学习之路一 2016年6月30日
以前下载ecshop 都是在ecshop官网上下载,前后台模板都很难看.功能也不太齐全,这次在模板堂下载了ecshop 模板仿小米的.做一个简单的电商网站. 页面结构还是挺简单的.功能也齐全.用ec ...
cocos2d-x 纹理源码分析
转自:http://blog.csdn.net/honghaier/article/details/8068895 当一张图片被加载到内存后,它是以纹理的形式存在的.纹理是什么东西呢?纹理就是一块内存 ...
glsl水包含倒影的实现(rtt) [转]
转自 http://blog.sina.com.cn/s/blog_78ea87380101eixi.html 此文实现一个简单地水面倒影效果,通过rtt相机获取倒影纹理, 水的基本实现方法(参考前 ...
利用ajax获取到的网页源码不能执行js代码
今天觉得我的博客中加载腾讯微博的速度很慢,所以就想改写为js,本来以为直接新建一个页面,把获取函数移到新的页面中,原来的页面只要使用xmlhttp去GET一下,然后把div的innerhtml属性等于 ...
MySQL 5.7 新特性大全和未来展望图解
本文转自微信公众号:高可用架构作者:杨尚刚引用美图公司数据库高级 DBA,负责美图后端数据存储平台建设和架构设计.前新浪高级数据库工程师,负责新浪微博核心数据库架构改造优化,以及数据库相关的服务 ...
【ZZ】超全面的设计模式总结
http://www.cnblogs.com/chenssy/p/3357683.html#rd
Python Generators(生成器)--yield
参考:http://blog.csdn.net/scelong/article/details/6969276 Python生成器什么是python生成器,意思是带有一个yield语句的函数,既然它 ...
Python学习之运算符&表达式
1.Python运算符包括:赋值运算符.算术运算符.关系运算符.逻辑运算符. 表达式是将不同的数据(包括变量.函数)用运算符号按一定规则连接起来的一种式子. 2.赋值运算符:=.+=.-=.*=./= ...
CentOS中查看系统资源占用情况的命令
用 'top -i' 看看有多少进程处于 Running 状态,可能系统存在内存或 I/O 瓶颈,用 free 看看系统内存使用情况,swap 是否被占用很多,用 iostat 看看 I/O 负载情况 ...
hdu1051 Wooden Sticks
题目:http://acm.hdu.edu.cn/showproblem.php?pid=1051 大意:求最少升序序列的个数. #include <cstdio> #include &l ...

hive创建表带中文注释报错解决方法

hive创建表带中文注释报错解决方法的更多相关文章

随机推荐

热门专题