hive分区表插入一条测试数据
1.show create table tb_cdr;
+-------------------------------------------------------+--+
| createtab_stmt |
+-------------------------------------------------------+--+
| CREATE TABLE `tb_cdr`( |
| `begintime` bigint, |
| `usernum` string, |
| `homearea` string, |
| `relatenum` string, |
| `relatehomeac` string, |
| `imsi` string, |
| `imei` string, |
| `curarea` string, |
| `neid` string, |
| `lai` int, |
| `ci` string, |
| `longitude` float, |
| `latitude` float, |
| `billtype` string, |
| `calltype` string, |
| `dtmf` string, |
| `callduration` int, |
| `cause` string, |
| `rlgtime` bigint, |
| `alerttime` bigint, |
| `connecttime` bigint, |
| `disconnecttime` bigint, |
| `sid` string, |
| `idflag` int, |
| `rawrelatenum` string, |
| `redirflag` int, |
| `origcalledno` string, |
| `disconnecttype` int, |
| `newlai` int, |
| `newci` string, |
| `newlongitude` float, |
| `newlatitude` float, |
| `tmsi` string, |
| `spcode` string, |
| `voiceflag` string, |
| `voicekeya` string, |
| `voicekeyb` string, |
| `peersid` string, |
| `guti` string, |
| `userip` string, |
| `cgi` string, |
| `newcgi` string, |
| `mobileip` string, |
| `imsip` string, |
| `recflag` int, |
| `holdflag` int, |
| `hocnt` int, |
| `mediatype` string, |
| `speechver` string, |
| `beartype` string, |
| `relatelai` int, |
| `relateci` int, |
| `relatelongitude` float, |
| `relatelatitude` float, |
| `relatecgi` string, |
| `client` string, |
| `tags` string, |
| `extra_longitude` float, |
| `extra_latitude` float, |
| `extra_newlongitude` float, |
| `extra_newlatitude` float, |
| `extra_relatelongitude` float, |
| `extra_relatelatitude` float, |
| `geohash` string, |
| `newgeohash` string, |
| `relategeohash` string) |
| PARTITIONED BY ( |
| `cp` bigint, |
| `ld` bigint) |
| ROW FORMAT SERDE |
| 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' |
| STORED AS INPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' |
| OUTPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat' |
| LOCATION |
| 'hdfs://hacluster/user/hive/warehouse/tb_cdr' |
| TBLPROPERTIES ( |
| 'last_modified_by'='omm', |
| 'last_modified_time'='1504964008', |
| 'orc.compress'='ZLIB', |
| 'transient_lastDdlTime'='1504964008') |
+-------------------------------------------------------+
+-------------------------------------------------------+--+
| createtab_stmt |
+-------------------------------------------------------+--+
| CREATE TABLE `tb_cdr`( |
| `begintime` bigint, |
| `usernum` string, |
| `homearea` string, |
| `relatenum` string, |
| `relatehomeac` string, |
| `imsi` string, |
| `imei` string, |
| `curarea` string, |
| `neid` string, |
| `lai` int, |
| `ci` string, |
| `longitude` float, |
| `latitude` float, |
| `billtype` string, |
| `calltype` string, |
| `dtmf` string, |
| `callduration` int, |
| `cause` string, |
| `rlgtime` bigint, |
| `alerttime` bigint, |
| `connecttime` bigint, |
| `disconnecttime` bigint, |
| `sid` string, |
| `idflag` int, |
| `rawrelatenum` string, |
| `redirflag` int, |
| `origcalledno` string, |
| `disconnecttype` int, |
| `newlai` int, |
| `newci` string, |
| `newlongitude` float, |
| `newlatitude` float, |
| `tmsi` string, |
| `spcode` string, |
| `voiceflag` string, |
| `voicekeya` string, |
| `voicekeyb` string, |
| `peersid` string, |
| `guti` string, |
| `userip` string, |
| `cgi` string, |
| `newcgi` string, |
| `mobileip` string, |
| `imsip` string, |
| `recflag` int, |
| `holdflag` int, |
| `hocnt` int, |
| `mediatype` string, |
| `speechver` string, |
| `beartype` string, |
| `relatelai` int, |
| `relateci` int, |
| `relatelongitude` float, |
| `relatelatitude` float, |
| `relatecgi` string, |
| `client` string, |
| `tags` string, |
| `extra_longitude` float, |
| `extra_latitude` float, |
| `extra_newlongitude` float, |
| `extra_newlatitude` float, |
| `extra_relatelongitude` float, |
| `extra_relatelatitude` float, |
| `geohash` string, |
| `newgeohash` string, |
| `relategeohash` string) |
| PARTITIONED BY ( |
| `cp` bigint, |
| `ld` bigint) |
| ROW FORMAT SERDE |
| 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' |
| STORED AS INPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' |
| OUTPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat' |
| LOCATION |
| 'hdfs://hacluster/user/hive/warehouse/tb_cdr' |
| TBLPROPERTIES ( |
| 'last_modified_by'='omm', |
| 'last_modified_time'='1504964008', |
| 'orc.compress'='ZLIB', |
| 'transient_lastDdlTime'='1504964008') |
+-------------------------------------------------------+
2.向表中插入一条数据
insert into table tb_cdr partition(cp=1,ld=2) values(
0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
0,
'a',
0,
0,
0,
0,
'a',
0,
'a',
0,
'a',
0,
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
0,
0,
'a',
'a',
'a',
0,
0,
0.0,
0.0,
'a',
'a',
'a',
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
'a',
'a',
'a');
insert into table tb_cdr partition(cp=1,ld=2) values(
0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
0,
'a',
0,
0,
0,
0,
'a',
0,
'a',
0,
'a',
0,
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
0,
0,
'a',
'a',
'a',
0,
0,
0.0,
0.0,
'a',
'a',
'a',
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
'a',
'a',
'a');
3.查询
select * from tb_cdr where cp=1 and ld=2 limit 1;
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| tb_cdr.begintime | tb_cdr.usernum | tb_cdr.homearea | tb_cdr.relatenum | tb_cdr.relatehomeac | tb_cdr.imsi | tb_cdr.imei | tb_cdr.curarea | tb_cdr.neid | tb_cdr.lai | tb_cdr.ci | tb_cdr.longitude | tb_cdr.latitude | tb_cdr.billtype | tb_cdr.calltype | tb_cdr.dtmf | tb_cdr.callduration | tb_cdr.cause | tb_cdr.rlgtime | tb_cdr.alerttime | tb_cdr.connecttime | tb_cdr.disconnecttime | tb_cdr.sid | tb_cdr.idflag | tb_cdr.rawrelatenum | tb_cdr.redirflag | tb_cdr.origcalledno | tb_cdr.disconnecttype | tb_cdr.newlai | tb_cdr.newci | tb_cdr.newlongitude | tb_cdr.newlatitude | tb_cdr.tmsi | tb_cdr.spcode | tb_cdr.voiceflag | tb_cdr.voicekeya | tb_cdr.voicekeyb | tb_cdr.peersid | tb_cdr.guti | tb_cdr.userip | tb_cdr.cgi | tb_cdr.newcgi | tb_cdr.mobileip | tb_cdr.imsip | tb_cdr.recflag | tb_cdr.holdflag | tb_cdr.hocnt | tb_cdr.mediatype | tb_cdr.speechver | tb_cdr.beartype | tb_cdr.relatelai | tb_cdr.relateci | tb_cdr.relatelongitude | tb_cdr.relatelatitude | tb_cdr.relatecgi | tb_cdr.client | tb_cdr.tags | tb_cdr.extra_longitude | tb_cdr.extra_latitude | tb_cdr.extra_newlongitude | tb_cdr.extra_newlatitude | tb_cdr.extra_relatelongitude | tb_cdr.extra_relatelatitude | tb_cdr.geohash | tb_cdr.newgeohash | tb_cdr.relategeohash | tb_cdr.cp | tb_cdr.ld |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| 0 | a | a | a | a | a | a | a | a | 0 | a | 0.0 | 0.0 | a | a | a | 0 | a | 0 | 0 | 0 | 0 | a | 0 | a | 0 | a | 0 | 0 | a | 0.0 | 0.0 | a | a | a | a | a | a | a | a | a | a | a | a | 0 | 0 | 0 | a | a | a | 0 | 0 | 0.0 | 0.0 | a | a | a | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | a | a | a | 1 | 2 |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
select * from tb_cdr where cp=1 and ld=2 limit 1;
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| tb_cdr.begintime | tb_cdr.usernum | tb_cdr.homearea | tb_cdr.relatenum | tb_cdr.relatehomeac | tb_cdr.imsi | tb_cdr.imei | tb_cdr.curarea | tb_cdr.neid | tb_cdr.lai | tb_cdr.ci | tb_cdr.longitude | tb_cdr.latitude | tb_cdr.billtype | tb_cdr.calltype | tb_cdr.dtmf | tb_cdr.callduration | tb_cdr.cause | tb_cdr.rlgtime | tb_cdr.alerttime | tb_cdr.connecttime | tb_cdr.disconnecttime | tb_cdr.sid | tb_cdr.idflag | tb_cdr.rawrelatenum | tb_cdr.redirflag | tb_cdr.origcalledno | tb_cdr.disconnecttype | tb_cdr.newlai | tb_cdr.newci | tb_cdr.newlongitude | tb_cdr.newlatitude | tb_cdr.tmsi | tb_cdr.spcode | tb_cdr.voiceflag | tb_cdr.voicekeya | tb_cdr.voicekeyb | tb_cdr.peersid | tb_cdr.guti | tb_cdr.userip | tb_cdr.cgi | tb_cdr.newcgi | tb_cdr.mobileip | tb_cdr.imsip | tb_cdr.recflag | tb_cdr.holdflag | tb_cdr.hocnt | tb_cdr.mediatype | tb_cdr.speechver | tb_cdr.beartype | tb_cdr.relatelai | tb_cdr.relateci | tb_cdr.relatelongitude | tb_cdr.relatelatitude | tb_cdr.relatecgi | tb_cdr.client | tb_cdr.tags | tb_cdr.extra_longitude | tb_cdr.extra_latitude | tb_cdr.extra_newlongitude | tb_cdr.extra_newlatitude | tb_cdr.extra_relatelongitude | tb_cdr.extra_relatelatitude | tb_cdr.geohash | tb_cdr.newgeohash | tb_cdr.relategeohash | tb_cdr.cp | tb_cdr.ld |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| 0 | a | a | a | a | a | a | a | a | 0 | a | 0.0 | 0.0 | a | a | a | 0 | a | 0 | 0 | 0 | 0 | a | 0 | a | 0 | a | 0 | 0 | a | 0.0 | 0.0 | a | a | a | a | a | a | a | a | a | a | a | a | 0 | 0 | 0 | a | a | a | 0 | 0 | 0.0 | 0.0 | a | a | a | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | a | a | a | 1 | 2 |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
hive分区表插入一条测试数据的更多相关文章
- mysql中迅速插入百万条测试数据的方法
对比一下,首先是用 mysql 的存储过程弄的: 复制代码代码如下: mysql>delimiter $ mysql>SET AUTOCOMMIT = 0$$ mysql> crea ...
- Oracle中插入千万条测试数据
测试需求,id.姓名.邮箱.手机号不可重复 1.创建序列 create sequence id_sequence; //创建序列id_sequence 2.创建表 create table USERI ...
- 利用MySQL存储过程批量插入100W条测试数据
DROP PROCEDURE IF EXISTS insert_batch; CREATE PROCEDURE insert_batch() BEGIN ; loopname:LOOP '); ; T ...
- Hadoop: the definitive guide 第三版 拾遗 第十二章 之Hive分区表、桶
Hive分区表 在Hive Select查询中一般会扫描整个表内容,会消耗很多时间做没必要的工作.有时候只需要扫描表中关心的一部分数据,因此建表时引入了partition概念.分区表指的是在创建表时指 ...
- Hive分区表的导入与导出
最近在做一个小任务,将一个CDH平台中Hive的部分数据同步到另一个平台中.毕竟我也刚开始工作,在正式开始做之前,首先进行了一段时间的练习,下面的内容就是练习时写的文档中的内容.如果哪里有错误或者疏漏 ...
- 记录一次mysql导入千万条测试数据过慢的问题！
数据库在没有做任何优化的情况下,使用存储过程,插入1千万条测试数据. CREATE PROCEDURE addmaxdata(IN n int) BEGIN DECLARE i INT DEFAULT ...
- MySQL快速生成100W条测试数据
https://blog.csdn.net/qq_16946803/article/details/81870174 1.生成思路利用mysql内存表插入速度快的特点,先利用函数和存储过程在内存表中生 ...
- java之5分钟插入千万条数据
虽说不一定5分钟就插入完毕,因为取决去所插入的字段,如果字段过多会稍微慢点,但不至于太慢.10分钟内基本能看到结果. 之前我尝试用多线程来实现数据插入(百万条数据),半个多小时才二十多万条数据. 线程 ...
- Oracle-创建新表，创建备份表，对表中插入多条数据
一.创建新表 0.基本语法 create table 表名称(id varchar2(50) primary key ,name char(200) not null,phone number(11) ...
随机推荐
- 对接外网post，get接口封装类库
public class HttpHelper { public static string GetAsync(string url) { HttpWebRequest request = WebR ...
- CSS总结六：动画(一)ransition:过渡、animation:动画、贝塞尔曲线、step值的应用
transition-property transition-duration transition-timing-function transition-delay animation-name a ...
- java八个框架
在本文中,我只是整理了以下主流框架: 1.阿帕切米纳 项目主页:http://mina.apache.org/ 它为开发高性能和高可用性网络应用提供了一个非常方便的框架,支持基于Java NIO技术的 ...
- 用php连接数据库，并执行数据库操作
1,建立与数据库之间的连接 (能通过php代码执行一个SQL语句得到查询的结果) <?php mysqli_connect(' , 'demo01'); 这里要注意两个问题: ①mysqli 是 ...
- MYSQL 删除语句(数据)
删除数据(DELETE) 如果你失忆了,希望你能想起曾经为了追求梦想的你. 数据库存储数据,总会有一些垃圾数据,也会有一些不需要用的数据了,这些情况下,我们就可以删除这些数据,释放出一定的 ...
- tensorflow-解决3个问题
问题一:对特征归一化 Min-Max Scaling: X′=a+(X−Xmin)(b−a)/(Xmax−Xmin) # Problem 1 - Implement Min-Max scaling f ...
- 5.Linux 软件安装管理
1.RPM包安装 (RPM会有依赖性,即安装这个包之前,需要安装某个包) 查询已安装的rpm 列表 rpm -qa | grep xx 安装rpm包 rpm -ivh rpm 包名 -i ...
- shell中$(( ))、$( )、``与${ }的区别详解
命令替换在bash中,$( )与` `(反引号)都是用来作命令替换的.命令替换与变量替换差不多,都是用来重组命令行的,先完成引号里的命令行,然后将其结果替换出来,再重组成新的命令行 [python@m ...
- kubesphere-wokespaces
kubesphere - workspaces 详解: workspaces :企业空间 登陆kubesphere后,会看到一个默认的企业空间 " system-workspace &q ...
- JDBC的两种sql命令发送器比较【Statement：PreparedStatement】
PreparedStatement 接口继承 Statement接口如果需要多次执行一个SQL语句,可以使用PreparedStatement对象.在创建PreparedStatement对象时,通过 ...