hive分区表插入一条测试数据
1.show create table tb_cdr;
+-------------------------------------------------------+--+
| createtab_stmt |
+-------------------------------------------------------+--+
| CREATE TABLE `tb_cdr`( |
| `begintime` bigint, |
| `usernum` string, |
| `homearea` string, |
| `relatenum` string, |
| `relatehomeac` string, |
| `imsi` string, |
| `imei` string, |
| `curarea` string, |
| `neid` string, |
| `lai` int, |
| `ci` string, |
| `longitude` float, |
| `latitude` float, |
| `billtype` string, |
| `calltype` string, |
| `dtmf` string, |
| `callduration` int, |
| `cause` string, |
| `rlgtime` bigint, |
| `alerttime` bigint, |
| `connecttime` bigint, |
| `disconnecttime` bigint, |
| `sid` string, |
| `idflag` int, |
| `rawrelatenum` string, |
| `redirflag` int, |
| `origcalledno` string, |
| `disconnecttype` int, |
| `newlai` int, |
| `newci` string, |
| `newlongitude` float, |
| `newlatitude` float, |
| `tmsi` string, |
| `spcode` string, |
| `voiceflag` string, |
| `voicekeya` string, |
| `voicekeyb` string, |
| `peersid` string, |
| `guti` string, |
| `userip` string, |
| `cgi` string, |
| `newcgi` string, |
| `mobileip` string, |
| `imsip` string, |
| `recflag` int, |
| `holdflag` int, |
| `hocnt` int, |
| `mediatype` string, |
| `speechver` string, |
| `beartype` string, |
| `relatelai` int, |
| `relateci` int, |
| `relatelongitude` float, |
| `relatelatitude` float, |
| `relatecgi` string, |
| `client` string, |
| `tags` string, |
| `extra_longitude` float, |
| `extra_latitude` float, |
| `extra_newlongitude` float, |
| `extra_newlatitude` float, |
| `extra_relatelongitude` float, |
| `extra_relatelatitude` float, |
| `geohash` string, |
| `newgeohash` string, |
| `relategeohash` string) |
| PARTITIONED BY ( |
| `cp` bigint, |
| `ld` bigint) |
| ROW FORMAT SERDE |
| 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' |
| STORED AS INPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' |
| OUTPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat' |
| LOCATION |
| 'hdfs://hacluster/user/hive/warehouse/tb_cdr' |
| TBLPROPERTIES ( |
| 'last_modified_by'='omm', |
| 'last_modified_time'='1504964008', |
| 'orc.compress'='ZLIB', |
| 'transient_lastDdlTime'='1504964008') |
+-------------------------------------------------------+
+-------------------------------------------------------+--+
| createtab_stmt |
+-------------------------------------------------------+--+
| CREATE TABLE `tb_cdr`( |
| `begintime` bigint, |
| `usernum` string, |
| `homearea` string, |
| `relatenum` string, |
| `relatehomeac` string, |
| `imsi` string, |
| `imei` string, |
| `curarea` string, |
| `neid` string, |
| `lai` int, |
| `ci` string, |
| `longitude` float, |
| `latitude` float, |
| `billtype` string, |
| `calltype` string, |
| `dtmf` string, |
| `callduration` int, |
| `cause` string, |
| `rlgtime` bigint, |
| `alerttime` bigint, |
| `connecttime` bigint, |
| `disconnecttime` bigint, |
| `sid` string, |
| `idflag` int, |
| `rawrelatenum` string, |
| `redirflag` int, |
| `origcalledno` string, |
| `disconnecttype` int, |
| `newlai` int, |
| `newci` string, |
| `newlongitude` float, |
| `newlatitude` float, |
| `tmsi` string, |
| `spcode` string, |
| `voiceflag` string, |
| `voicekeya` string, |
| `voicekeyb` string, |
| `peersid` string, |
| `guti` string, |
| `userip` string, |
| `cgi` string, |
| `newcgi` string, |
| `mobileip` string, |
| `imsip` string, |
| `recflag` int, |
| `holdflag` int, |
| `hocnt` int, |
| `mediatype` string, |
| `speechver` string, |
| `beartype` string, |
| `relatelai` int, |
| `relateci` int, |
| `relatelongitude` float, |
| `relatelatitude` float, |
| `relatecgi` string, |
| `client` string, |
| `tags` string, |
| `extra_longitude` float, |
| `extra_latitude` float, |
| `extra_newlongitude` float, |
| `extra_newlatitude` float, |
| `extra_relatelongitude` float, |
| `extra_relatelatitude` float, |
| `geohash` string, |
| `newgeohash` string, |
| `relategeohash` string) |
| PARTITIONED BY ( |
| `cp` bigint, |
| `ld` bigint) |
| ROW FORMAT SERDE |
| 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' |
| STORED AS INPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' |
| OUTPUTFORMAT |
| 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat' |
| LOCATION |
| 'hdfs://hacluster/user/hive/warehouse/tb_cdr' |
| TBLPROPERTIES ( |
| 'last_modified_by'='omm', |
| 'last_modified_time'='1504964008', |
| 'orc.compress'='ZLIB', |
| 'transient_lastDdlTime'='1504964008') |
+-------------------------------------------------------+
2.向表中插入一条数据
insert into table tb_cdr partition(cp=1,ld=2) values(
0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
0,
'a',
0,
0,
0,
0,
'a',
0,
'a',
0,
'a',
0,
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
0,
0,
'a',
'a',
'a',
0,
0,
0.0,
0.0,
'a',
'a',
'a',
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
'a',
'a',
'a');
insert into table tb_cdr partition(cp=1,ld=2) values(
0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
0,
'a',
0,
0,
0,
0,
'a',
0,
'a',
0,
'a',
0,
0,
'a',
0.0,
0.0,
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
'a',
0,
0,
0,
'a',
'a',
'a',
0,
0,
0.0,
0.0,
'a',
'a',
'a',
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
'a',
'a',
'a');
3.查询
select * from tb_cdr where cp=1 and ld=2 limit 1;
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| tb_cdr.begintime | tb_cdr.usernum | tb_cdr.homearea | tb_cdr.relatenum | tb_cdr.relatehomeac | tb_cdr.imsi | tb_cdr.imei | tb_cdr.curarea | tb_cdr.neid | tb_cdr.lai | tb_cdr.ci | tb_cdr.longitude | tb_cdr.latitude | tb_cdr.billtype | tb_cdr.calltype | tb_cdr.dtmf | tb_cdr.callduration | tb_cdr.cause | tb_cdr.rlgtime | tb_cdr.alerttime | tb_cdr.connecttime | tb_cdr.disconnecttime | tb_cdr.sid | tb_cdr.idflag | tb_cdr.rawrelatenum | tb_cdr.redirflag | tb_cdr.origcalledno | tb_cdr.disconnecttype | tb_cdr.newlai | tb_cdr.newci | tb_cdr.newlongitude | tb_cdr.newlatitude | tb_cdr.tmsi | tb_cdr.spcode | tb_cdr.voiceflag | tb_cdr.voicekeya | tb_cdr.voicekeyb | tb_cdr.peersid | tb_cdr.guti | tb_cdr.userip | tb_cdr.cgi | tb_cdr.newcgi | tb_cdr.mobileip | tb_cdr.imsip | tb_cdr.recflag | tb_cdr.holdflag | tb_cdr.hocnt | tb_cdr.mediatype | tb_cdr.speechver | tb_cdr.beartype | tb_cdr.relatelai | tb_cdr.relateci | tb_cdr.relatelongitude | tb_cdr.relatelatitude | tb_cdr.relatecgi | tb_cdr.client | tb_cdr.tags | tb_cdr.extra_longitude | tb_cdr.extra_latitude | tb_cdr.extra_newlongitude | tb_cdr.extra_newlatitude | tb_cdr.extra_relatelongitude | tb_cdr.extra_relatelatitude | tb_cdr.geohash | tb_cdr.newgeohash | tb_cdr.relategeohash | tb_cdr.cp | tb_cdr.ld |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| 0 | a | a | a | a | a | a | a | a | 0 | a | 0.0 | 0.0 | a | a | a | 0 | a | 0 | 0 | 0 | 0 | a | 0 | a | 0 | a | 0 | 0 | a | 0.0 | 0.0 | a | a | a | a | a | a | a | a | a | a | a | a | 0 | 0 | 0 | a | a | a | 0 | 0 | 0.0 | 0.0 | a | a | a | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | a | a | a | 1 | 2 |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
select * from tb_cdr where cp=1 and ld=2 limit 1;
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| tb_cdr.begintime | tb_cdr.usernum | tb_cdr.homearea | tb_cdr.relatenum | tb_cdr.relatehomeac | tb_cdr.imsi | tb_cdr.imei | tb_cdr.curarea | tb_cdr.neid | tb_cdr.lai | tb_cdr.ci | tb_cdr.longitude | tb_cdr.latitude | tb_cdr.billtype | tb_cdr.calltype | tb_cdr.dtmf | tb_cdr.callduration | tb_cdr.cause | tb_cdr.rlgtime | tb_cdr.alerttime | tb_cdr.connecttime | tb_cdr.disconnecttime | tb_cdr.sid | tb_cdr.idflag | tb_cdr.rawrelatenum | tb_cdr.redirflag | tb_cdr.origcalledno | tb_cdr.disconnecttype | tb_cdr.newlai | tb_cdr.newci | tb_cdr.newlongitude | tb_cdr.newlatitude | tb_cdr.tmsi | tb_cdr.spcode | tb_cdr.voiceflag | tb_cdr.voicekeya | tb_cdr.voicekeyb | tb_cdr.peersid | tb_cdr.guti | tb_cdr.userip | tb_cdr.cgi | tb_cdr.newcgi | tb_cdr.mobileip | tb_cdr.imsip | tb_cdr.recflag | tb_cdr.holdflag | tb_cdr.hocnt | tb_cdr.mediatype | tb_cdr.speechver | tb_cdr.beartype | tb_cdr.relatelai | tb_cdr.relateci | tb_cdr.relatelongitude | tb_cdr.relatelatitude | tb_cdr.relatecgi | tb_cdr.client | tb_cdr.tags | tb_cdr.extra_longitude | tb_cdr.extra_latitude | tb_cdr.extra_newlongitude | tb_cdr.extra_newlatitude | tb_cdr.extra_relatelongitude | tb_cdr.extra_relatelatitude | tb_cdr.geohash | tb_cdr.newgeohash | tb_cdr.relategeohash | tb_cdr.cp | tb_cdr.ld |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
| 0 | a | a | a | a | a | a | a | a | 0 | a | 0.0 | 0.0 | a | a | a | 0 | a | 0 | 0 | 0 | 0 | a | 0 | a | 0 | a | 0 | 0 | a | 0.0 | 0.0 | a | a | a | a | a | a | a | a | a | a | a | a | 0 | 0 | 0 | a | a | a | 0 | 0 | 0.0 | 0.0 | a | a | a | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | a | a | a | 1 | 2 |
+-------------------+-----------------+------------------+-------------------+----------------------+--------------+--------------+-----------------+--------------+-------------+------------+-------------------+------------------+------------------+------------------+--------------+----------------------+---------------+-----------------+-------------------+---------------------+------------------------+-------------+----------------+----------------------+-------------------+----------------------+------------------------+----------------+---------------+----------------------+---------------------+--------------+----------------+-------------------+-------------------+-------------------+-----------------+--------------+----------------+-------------+----------------+------------------+---------------+-----------------+------------------+---------------+-------------------+-------------------+------------------+-------------------+------------------+-------------------------+------------------------+-------------------+----------------+--------------+-------------------------+------------------------+----------------------------+---------------------------+-------------------------------+------------------------------+-----------------+--------------------+-----------------------+------------+------------+--+
hive分区表插入一条测试数据的更多相关文章
- mysql中迅速插入百万条测试数据的方法
对比一下,首先是用 mysql 的存储过程弄的: 复制代码代码如下: mysql>delimiter $ mysql>SET AUTOCOMMIT = 0$$ mysql> crea ...
- Oracle中插入千万条测试数据
测试需求,id.姓名.邮箱.手机号不可重复 1.创建序列 create sequence id_sequence; //创建序列id_sequence 2.创建表 create table USERI ...
- 利用MySQL存储过程批量插入100W条测试数据
DROP PROCEDURE IF EXISTS insert_batch; CREATE PROCEDURE insert_batch() BEGIN ; loopname:LOOP '); ; T ...
- Hadoop: the definitive guide 第三版 拾遗 第十二章 之Hive分区表、桶
Hive分区表 在Hive Select查询中一般会扫描整个表内容,会消耗很多时间做没必要的工作.有时候只需要扫描表中关心的一部分数据,因此建表时引入了partition概念.分区表指的是在创建表时指 ...
- Hive分区表的导入与导出
最近在做一个小任务,将一个CDH平台中Hive的部分数据同步到另一个平台中.毕竟我也刚开始工作,在正式开始做之前,首先进行了一段时间的练习,下面的内容就是练习时写的文档中的内容.如果哪里有错误或者疏漏 ...
- 记录一次mysql导入千万条测试数据过慢的问题！
数据库在没有做任何优化的情况下,使用存储过程,插入1千万条测试数据. CREATE PROCEDURE addmaxdata(IN n int) BEGIN DECLARE i INT DEFAULT ...
- MySQL快速生成100W条测试数据
https://blog.csdn.net/qq_16946803/article/details/81870174 1.生成思路利用mysql内存表插入速度快的特点,先利用函数和存储过程在内存表中生 ...
- java之5分钟插入千万条数据
虽说不一定5分钟就插入完毕,因为取决去所插入的字段,如果字段过多会稍微慢点,但不至于太慢.10分钟内基本能看到结果. 之前我尝试用多线程来实现数据插入(百万条数据),半个多小时才二十多万条数据. 线程 ...
- Oracle-创建新表，创建备份表，对表中插入多条数据
一.创建新表 0.基本语法 create table 表名称(id varchar2(50) primary key ,name char(200) not null,phone number(11) ...
随机推荐
- Springboot Hikari Centos 首次连数据库很慢
前言: springboot项目默认使用了hikari作为数据库连接池,在开发机器上一切正常. 但是把程序部署到Centos7 x64上之后发现,每次首页登录的时候都要停顿几十秒. 于是,在程序启动后 ...
- qq快捷打开聊天窗口的代码
pc代码: http://wpa.qq.com/msgrd?v=3&uin=8423291&site=qq&menu=yes
- css3常用样式
.box{ //改变轴的方向 flex-direction:column; //两端对齐 justify-content:space-between; //换行 flex-wrap: wrap; // ...
- textarea回填数据显示自适应高度
queryTextArea(){ var textAll = document.getElementById('templaInner').querySelectorAll("textare ...
- ubuntu系统搭建samba服务
安装samba服务 # apt-get install samba 创建一个samba服务的分享目录 # mkdir /share 创建一个samba服务限制的用户及组 #useradd public ...
- Manticore search加一个中文分词
Sphinx search 是一款非常棒的开源全文搜索引擎,它使用C++开发,索引和搜索的速度非常快,我使用sphinx的时间也有好多年了.最初使用的是coreseek,一个国人在sphinxsear ...
- kotlin默认参数和具名参数
纯语法操练,这里先定义一些数学计算公式,顺便来复习复习,如下: 然后编写测试代码来调用下它们: 编译运行: 但是!!!对于这四个函数都有一个参数是pi: 而实际上它是一个常量,可以手动给它定义一个默认 ...
- C/C++小课之数组名是什么
我们今天讨论数组名是什么东西,理解它有助于我们进一步理解和使用指针. 因为它涉及到了内存地址. 问题 数组名是什么?含义是什么? 思路 前提 一个值+1之后的变化可以反映出它的意义/含义. 前提的证明 ...
- 使用python读取配置文件并从mysql数据库中获取数据进行传参（基于Httprunner）
最近在使用httprunner进行接口测试,在传参时,用到了三种方法:(1)从csv文件中获取:(2)在config中声名然后进行引用:(3)从函数中获取.在测试过程中,往往有些参数是需要从数据库中获 ...
- mybatic MapperScannerConfigurer的原理
原文地址:http://www.cnblogs.com/fangjian0423/p/spring-mybatis-MapperScannerConfigurer-analysis.html 前言 本 ...