hive分区表插入一条测试数据
1.show create table tb_cdr;
+-------------------------------------------------------+--+
| createtab_stmt |
+-------------------------------------------------------+--+
| CREATE TABLE `tb_cdr`( |
| `begintime` bigint, |
| `usernum` string, |
| `homearea` string, |
| `relatenum` string, |
| `relatehomeac` string, |
| `imsi` string, |
| `imei` string, |
| `curarea` string, |
| `neid` string, |
| `lai` int, |
| `ci` string, |
| `longitude` float, |
| `latitude` float, |
| `billtype` string, |
| `calltype` string, |
| `dtmf` string, |
| `callduration` int, |
| `cause` string, |
| `rlgtime` bigint, |
| `alerttime` bigint, |
| `connecttime` bigint, |
| `disconnecttime` bigint, |
| `sid` string, |
| `idflag` int, |
| `rawrelatenum` string, |
| `redirflag` int, |
| `origcalledno` string, |
| `disconnecttype` int, |
| `newlai` int, |
| `newci` string, |
| `newlongitude` float, |
| `newlatitude` float, |
| `tmsi` string, |
| `spcode` string, |
| `voiceflag` string, |
| `voicekeya` string, |
| `voicekeyb` string, |
| `peersid` string, |
| `guti` string, |
| `userip` string, |
| `cgi` string, |
| `newcgi` string, |
| `mobileip` string, |
| `imsip` string, |
| `recflag` int, |
| `holdflag` int, |
| `hocnt` int, |
| `mediatype` string, |
| `speechver` string, |
| `beartype` string, |
| `relatelai` int, |
| `relateci` int, |
| `relatelongitude` float, |
| `relatelatitude` float, |
| `relatecgi` string, |
| `client` string, |
| `tags` string, |
| `extra_longitude` float, |
| `extra_latitude` float, |
| `extra_newlongitude` float, |
| `extra_newlatitude` float, |
| `extra_relatelongitude` float, |
| `extra_relatelatitude` float, |
| `geohash` string, |
| `newgeohash` string, |
| `relategeohash` string) |
| PARTITIONED BY ( |
| `cp` bigint, |
| `ld` bigint) |
| ROW FORMAT SERDE |
| 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' |
| STORED AS INPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' |
| OUTPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat' |
| LOCATION |
| 'hdfs://hacluster/user/hive/warehouse/tb_cdr' |
| TBLPROPERTIES ( |
| 'last_modified_by'='omm', |
| 'last_modified_time'='1504964008', |
| 'orc.compress'='ZLIB', |
| 'transient_lastDdlTime'='1504964008') |
+-------------------------------------------------------+
+-------------------------------------------------------+--+
| createtab_stmt |
+-------------------------------------------------------+--+
| CREATE TABLE `tb_cdr`( |
| `begintime` bigint, |
| `usernum` string, |
| `homearea` string, |
| `relatenum` string, |
| `relatehomeac` string, |
| `imsi` string, |
| `imei` string, |
| `curarea` string, |
| `neid` string, |
| `lai` int, |
| `ci` string, |
| `longitude` float, |
| `latitude` float, |
| `billtype` string, |
| `calltype` string, |
| `dtmf` string, |
| `callduration` int, |
| `cause` string, |
| `rlgtime` bigint, |
| `alerttime` bigint, |
| `connecttime` bigint, |
| `disconnecttime` bigint, |
| `sid` string, |
| `idflag` int, |
| `rawrelatenum` string, |
| `redirflag` int, |
| `origcalledno` string, |
| `disconnecttype` int, |
| `newlai` int, |
| `newci` string, |
| `newlongitude` float, |
| `newlatitude` float, |
| `tmsi` string, |
| `spcode` string, |
| `voiceflag` string, |
| `voicekeya` string, |
| `voicekeyb` string, |
| `peersid` string, |
| `guti` string, |
| `userip` string, |
| `cgi` string, |
| `newcgi` string, |
| `mobileip` string, |
| `imsip` string, |
| `recflag` int, |
| `holdflag` int, |
| `hocnt` int, |
| `mediatype` string, |
| `speechver` string, |
| `beartype` string, |
| `relatelai` int, |
| `relateci` int, |
| `relatelongitude` float, |
| `relatelatitude` float, |
| `relatecgi` string, |
| `client` string, |
| `tags` string, |
| `extra_longitude` float, |
| `extra_latitude` float, |
| `extra_newlongitude` float, |
| `extra_newlatitude` float, |
| `extra_relatelongitude` float, |
| `extra_relatelatitude` float, |
| `geohash` string, |
| `newgeohash` string, |
| `relategeohash` string) |
| PARTITIONED BY ( |
| `cp` bigint, |
| `ld` bigint) |
| ROW FORMAT SERDE |
| 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' |
| STORED AS INPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' |
| OUTPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat' |
| LOCATION |
| 'hdfs://hacluster/user/hive/warehouse/tb_cdr' |
| TBLPROPERTIES ( |
| 'last_modified_by'='omm', |
| 'last_modified_time'='1504964008', |
| 'orc.compress'='ZLIB', |
| 'transient_lastDdlTime'='1504964008') |
+-------------------------------------------------------+
2.向表中插入一条数据
insert into table tb_cdr partition(cp=1,ld=2) values(
0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
0,
'a',
0,
0,
0,
0,
'a',
0,
'a',
0,
'a',
0,
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
0,
0,
'a',
'a',
'a',
0,
0,
0.0,
0.0,
'a',
'a',
'a',
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
'a',
'a',
'a');
insert into table tb_cdr partition(cp=1,ld=2) values(
0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
0,
'a',
0,
0,
0,
0,
'a',
0,
'a',
0,
'a',
0,
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
0,
0,
'a',
'a',
'a',
0,
0,
0.0,
0.0,
'a',
'a',
'a',
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
'a',
'a',
'a');
3.查询
select * from tb_cdr where cp=1 and ld=2 limit 1;
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| tb_cdr.begintime | tb_cdr.usernum | tb_cdr.homearea | tb_cdr.relatenum | tb_cdr.relatehomeac | tb_cdr.imsi | tb_cdr.imei | tb_cdr.curarea | tb_cdr.neid | tb_cdr.lai | tb_cdr.ci | tb_cdr.longitude | tb_cdr.latitude | tb_cdr.billtype | tb_cdr.calltype | tb_cdr.dtmf | tb_cdr.callduration | tb_cdr.cause | tb_cdr.rlgtime | tb_cdr.alerttime | tb_cdr.connecttime | tb_cdr.disconnecttime | tb_cdr.sid | tb_cdr.idflag | tb_cdr.rawrelatenum | tb_cdr.redirflag | tb_cdr.origcalledno | tb_cdr.disconnecttype | tb_cdr.newlai | tb_cdr.newci | tb_cdr.newlongitude | tb_cdr.newlatitude | tb_cdr.tmsi | tb_cdr.spcode | tb_cdr.voiceflag | tb_cdr.voicekeya | tb_cdr.voicekeyb | tb_cdr.peersid | tb_cdr.guti | tb_cdr.userip | tb_cdr.cgi | tb_cdr.newcgi | tb_cdr.mobileip | tb_cdr.imsip | tb_cdr.recflag | tb_cdr.holdflag | tb_cdr.hocnt | tb_cdr.mediatype | tb_cdr.speechver | tb_cdr.beartype | tb_cdr.relatelai | tb_cdr.relateci | tb_cdr.relatelongitude | tb_cdr.relatelatitude | tb_cdr.relatecgi | tb_cdr.client | tb_cdr.tags | tb_cdr.extra_longitude | tb_cdr.extra_latitude | tb_cdr.extra_newlongitude | tb_cdr.extra_newlatitude | tb_cdr.extra_relatelongitude | tb_cdr.extra_relatelatitude | tb_cdr.geohash | tb_cdr.newgeohash | tb_cdr.relategeohash | tb_cdr.cp | tb_cdr.ld |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| 0 | a | a | a | a | a | a | a | a | 0 | a | 0.0 | 0.0 | a | a | a | 0 | a | 0 | 0 | 0 | 0 | a | 0 | a | 0 | a | 0 | 0 | a | 0.0 | 0.0 | a | a | a | a | a | a | a | a | a | a | a | a | 0 | 0 | 0 | a | a | a | 0 | 0 | 0.0 | 0.0 | a | a | a | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | a | a | a | 1 | 2 |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
select * from tb_cdr where cp=1 and ld=2 limit 1;
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| tb_cdr.begintime | tb_cdr.usernum | tb_cdr.homearea | tb_cdr.relatenum | tb_cdr.relatehomeac | tb_cdr.imsi | tb_cdr.imei | tb_cdr.curarea | tb_cdr.neid | tb_cdr.lai | tb_cdr.ci | tb_cdr.longitude | tb_cdr.latitude | tb_cdr.billtype | tb_cdr.calltype | tb_cdr.dtmf | tb_cdr.callduration | tb_cdr.cause | tb_cdr.rlgtime | tb_cdr.alerttime | tb_cdr.connecttime | tb_cdr.disconnecttime | tb_cdr.sid | tb_cdr.idflag | tb_cdr.rawrelatenum | tb_cdr.redirflag | tb_cdr.origcalledno | tb_cdr.disconnecttype | tb_cdr.newlai | tb_cdr.newci | tb_cdr.newlongitude | tb_cdr.newlatitude | tb_cdr.tmsi | tb_cdr.spcode | tb_cdr.voiceflag | tb_cdr.voicekeya | tb_cdr.voicekeyb | tb_cdr.peersid | tb_cdr.guti | tb_cdr.userip | tb_cdr.cgi | tb_cdr.newcgi | tb_cdr.mobileip | tb_cdr.imsip | tb_cdr.recflag | tb_cdr.holdflag | tb_cdr.hocnt | tb_cdr.mediatype | tb_cdr.speechver | tb_cdr.beartype | tb_cdr.relatelai | tb_cdr.relateci | tb_cdr.relatelongitude | tb_cdr.relatelatitude | tb_cdr.relatecgi | tb_cdr.client | tb_cdr.tags | tb_cdr.extra_longitude | tb_cdr.extra_latitude | tb_cdr.extra_newlongitude | tb_cdr.extra_newlatitude | tb_cdr.extra_relatelongitude | tb_cdr.extra_relatelatitude | tb_cdr.geohash | tb_cdr.newgeohash | tb_cdr.relategeohash | tb_cdr.cp | tb_cdr.ld |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| 0 | a | a | a | a | a | a | a | a | 0 | a | 0.0 | 0.0 | a | a | a | 0 | a | 0 | 0 | 0 | 0 | a | 0 | a | 0 | a | 0 | 0 | a | 0.0 | 0.0 | a | a | a | a | a | a | a | a | a | a | a | a | 0 | 0 | 0 | a | a | a | 0 | 0 | 0.0 | 0.0 | a | a | a | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | a | a | a | 1 | 2 |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
hive分区表插入一条测试数据的更多相关文章
- mysql中迅速插入百万条测试数据的方法
对比一下,首先是用 mysql 的存储过程弄的: 复制代码代码如下: mysql>delimiter $ mysql>SET AUTOCOMMIT = 0$$ mysql> crea ...
- Oracle中插入千万条测试数据
测试需求,id.姓名.邮箱.手机号不可重复 1.创建序列 create sequence id_sequence; //创建序列id_sequence 2.创建表 create table USERI ...
- 利用MySQL存储过程批量插入100W条测试数据
DROP PROCEDURE IF EXISTS insert_batch; CREATE PROCEDURE insert_batch() BEGIN ; loopname:LOOP '); ; T ...
- Hadoop: the definitive guide 第三版 拾遗 第十二章 之Hive分区表、桶
Hive分区表 在Hive Select查询中一般会扫描整个表内容,会消耗很多时间做没必要的工作.有时候只需要扫描表中关心的一部分数据,因此建表时引入了partition概念.分区表指的是在创建表时指 ...
- Hive分区表的导入与导出
最近在做一个小任务,将一个CDH平台中Hive的部分数据同步到另一个平台中.毕竟我也刚开始工作,在正式开始做之前,首先进行了一段时间的练习,下面的内容就是练习时写的文档中的内容.如果哪里有错误或者疏漏 ...
- 记录一次mysql导入千万条测试数据过慢的问题！
数据库在没有做任何优化的情况下,使用存储过程,插入1千万条测试数据. CREATE PROCEDURE addmaxdata(IN n int) BEGIN DECLARE i INT DEFAULT ...
- MySQL快速生成100W条测试数据
https://blog.csdn.net/qq_16946803/article/details/81870174 1.生成思路利用mysql内存表插入速度快的特点,先利用函数和存储过程在内存表中生 ...
- java之5分钟插入千万条数据
虽说不一定5分钟就插入完毕,因为取决去所插入的字段,如果字段过多会稍微慢点,但不至于太慢.10分钟内基本能看到结果. 之前我尝试用多线程来实现数据插入(百万条数据),半个多小时才二十多万条数据. 线程 ...
- Oracle-创建新表，创建备份表，对表中插入多条数据
一.创建新表 0.基本语法 create table 表名称(id varchar2(50) primary key ,name char(200) not null,phone number(11) ...
随机推荐
- 10 Django之Ajax请求
一.什么是Ajax技术? 异步的JavaScript和XML.使用Javascript语言与服务器进行异步交互,传输的数据为XML(更多的使用json数据).Ajax不是一门新的编程语言,而是一种使用 ...
- js中with的作用
js中with的作用当一个对象有多个需要操作的属性或方法时,可以使用如<体>试验<script type=“text/javascript”>var o=文件.创建元素(“DI ...
- Scala获取main函数参数，idea演示
1 代码示范 /** * @author zhangjin * @create 2019-06-09 11:15 */ object TestMarnArgs { def main(args: Arr ...
- 第十一章· MHA高可用及读写分离
一.MHA简介 1.1.作者简介 松信嘉範: MySQL/Linux专家 2001年索尼公司入职 2001年开始使用oracle 2004年开始使用MySQL 2006年9月-2010年8月MySQL ...
- 5.Nginx的session一致性(共享)问题配置方案1
1:Session共享 为什么要实现共享,如果你的网站是存放在一个机器上,那么会话数据就在这台机器,但是如果你使用了负载均衡把请求分发到不同的机器呢?这个时候会话 id在客户端是没有问题的,但是如果用 ...
- jsp学习——九大内置对象
JSP一共有九个内置对象,分别为:request.response.session.application.out.pagecontext.config.page.exception 博客:JSP的九 ...
- 【获取url 问号后参数】防中文乱码
function getQueryString(name) { var reg = new RegExp("(^|&)" + name + "=([^&] ...
- 数据库——Oracle(3)
1 排序:对查询返回的结果,根据某一个列或者某几个列的列值大小进行升序或者降序排列. 1)根据某一个列的列值大小进行升序或者降序排列 格式: select 列名/* from 表名 order by ...
- “美登杯”上海市高校大学生程序设计邀请赛 **D. 小花梨的取石子游戏**
"美登杯"上海市高校大学生程序设计邀请赛 (华东理工大学) D. 小花梨的取石子游戏 Description 小花梨有
- [易学易懂系列|rustlang语言|零基础|快速入门|（26）|实战3：Http服务器（多线程版本）]
[易学易懂系列|rustlang语言|零基础|快速入门|(26)|实战3:Http服务器(多线程版本)] 项目实战 实战3:Http服务器 我们今天来进一步开发我们的Http服务器,用多线程实现. 我 ...