Hive desc
Describe Database
hive> DESCRIBE DATABASE test;
test ??? hdfs://ns1/user/hive/warehouse/test.db wx USER
hive> DESCRIBE DATABASE EXTENDED test;
test ??? hdfs://ns1/user/hive/warehouse/test.db wx USER {date=2015-07-18, creator=wx}
Describe Table/View/Column
hive> DESCRIBE user_info_bucketed;
user_id bigint
firstname string
lastname string
ds string
# Partition Information
# col_name data_type comment
ds string
hive> DESCRIBE FORMATTED user_info_bucketed.firstname
hive> DESCRIBE FORMATTED user_info_bucketed firstname;
# col_name data_type min max num_nulls distinct_count avg_col_len max_col_len num_trues num_falses comment
firstname string from deserializer
hive> DESCRIBE EXTENDED user_info_bucketed.firstname;
firstname string from deserializer
hive> DESCRIBE FORMATTED user_info_bucketed;
# col_name data_type comment
user_id bigint
firstname string
lastname string
# Partition Information
# col_name data_type comment
ds string
# Detailed Table Information
Database: test
Owner: huai
CreateTime: Sat Jul 25 10:56:50 CST 2015
LastAccessTime: UNKNOWN
Protect Mode: None
Retention: 0
Location: hdfs://ns1/user/hive/warehouse/test.db/user_info_bucketed
Table Type: MANAGED_TABLE
Table Parameters:
comment A bucketed copy of user_info
transient_lastDdlTime 1437793010
# Storage Information
SerDe Library: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
InputFormat: org.apache.hadoop.mapred.TextInputFormat
OutputFormat: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
Compressed: No
Num Buckets: 3
Bucket Columns: [user_id]
Sort Columns: [Order(col:firstname, order:1)]
Storage Desc Params:
serialization.format 1
hive> DESCRIBE EXTENDED user_info_bucketed;
user_id bigint
firstname string
lastname string
ds string
# Partition Information
# col_name data_type comment
ds string
Detailed Table Information Table(tableName:user_info_bucketed, dbName:test, owner:huai, createTime:1437793010, lastAccessTime:0, retention:0, sd:StorageDescriptor(cols:[FieldSchema(name:user_id, type:bigint, comment:null), FieldSchema(name:firstname, type:string, comment:null), FieldSchema(name:lastname, type:string, comment:null), FieldSchema(name:ds, type:string, comment:null)], location:hdfs://ns1/user/hive/warehouse/test.db/user_info_bucketed, inputFormat:org.apache.hadoop.mapred.TextInputFormat, outputFormat:org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat, compressed:false, numBuckets:3, serdeInfo:SerDeInfo(name:null, serializationLib:org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, parameters:{serialization.format=1}), bucketCols:[user_id], sortCols:[Order(col:firstname, order:1)], parameters:{}, skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[], skewedColValueLocationMaps:{}), storedAsSubDirectories:false), partitionKeys:[FieldSchema(name:ds, type:string, comment:null)], parameters:{transient_lastDdlTime=1437793010, comment=A bucketed copy of user_info}, viewOriginalText:null, viewExpandedText:null, tableType:MANAGED_TABLE)
Describe Partition
hive> DESCRIBE FORMATTED user_info_bucketed PARTITION (ds='2015-07-25');
# col_name data_type comment
user_id bigint
firstname string
lastname string
# Partition Information
# col_name data_type comment
ds string
# Detailed Partition Information
Partition Value: [2015-07-25]
Database: test
Table: user_info_bucketed
CreateTime: Sat Jul 25 10:59:28 CST 2015
LastAccessTime: UNKNOWN
Protect Mode: None
Location: hdfs://ns1/user/hive/warehouse/test.db/user_info_bucketed/ds=2015-07-25
Partition Parameters:
COLUMN_STATS_ACCURATE true
numFiles 3
numRows 4
rawDataSize 68
totalSize 72
transient_lastDdlTime 1437793168
# Storage Information
SerDe Library: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
InputFormat: org.apache.hadoop.mapred.TextInputFormat
OutputFormat: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
Compressed: No
Num Buckets: 3
Bucket Columns: [user_id]
Sort Columns: [Order(col:firstname, order:1)]
Storage Desc Params:
serialization.format 1
Hive desc的更多相关文章
- 附录C 编译安装Hive
如果需要直接安装Hive,可以跳过编译步骤,从Hive的官网下载编译好的安装包,下载地址为http://hive.apache.org/downloads.html . C.1 编译Hive C.1 ...
- Hive基本语法操练
建表规则如下: CREATE [EXTERNAL] TABLE [IF NOT EXISTS] table_name [(col_name data_type [COMMENT col_comment ...
- Spark入门实战系列--5.Hive(上)--Hive介绍及部署
[注]该系列文章以及使用到安装包/测试数据 可以在<倾情大奉送--Spark入门实战系列>获取 .Hive介绍 1.1 Hive介绍 月开源的一个数据仓库框架,提供了类似于SQL语法的HQ ...
- Hive介绍、安装(转)
1.Hive介绍 1.1 Hive介绍 Hive是一个基于Hadoop的开源数据仓库工具,用于存储和处理海量结构化数据.它是Facebook 2008年8月开源的一个数据仓库框架,提供了类似于SQL语 ...
- Sqoop_ 从 hive 导到mysql常遇九问题总结(转)
以前以为版本不同,遇到的问题就不同,后来发现,无论是新版本,还是老版本,遇到的问题大部分都是相同的.下面解决问题的方法仅供借鉴 1.拒绝连接的错误表现是什么?2.表不存在该如何解决?3.null字段填 ...
- hive学习3(hive基本操作)
hive基本操作 hive的数据类型 1)基本数据类型 TINYINT,SMALLINT,INT,BIGINT FLOAT/DOUBLE BOOLEAN STRING 2)复合类型 ARRAY:一组有 ...
- HIVE: Map Join Vs Common Join, and SMB
HIVE Map Join is nothing but the extended version of Hash Join of SQL Server - just extending Hash ...
- Hadoop第9周练习—Hive部署测试(含MySql部署)
1.1 2 :搭建Hive环境 内容 2.2 3 运行环境说明 1.1 硬软件环境 线程,主频2.2G,6G内存 l 虚拟软件:VMware® Workstation 9.0.0 build-8 ...
- hive的常用命令
#从hive中直接进入hdfs的daas/bstl/term/userinfo目录下 hive> !hadoop fs -ls /daas/bstl/term/userinfo; 查看hive表 ...
随机推荐
- Installing the Eclipse Plugin for ADT
http://developer.android.com/sdk/installing/installing-adt.html Download the ADT Plugin Start Ecli ...
- Servlet3简介
servlet基础知识:http://blog.csdn.net/chjttony/article/details/6086292 ServletContext相关知识:http://blog.csd ...
- 调试Java源代码时变量的值无法追踪怎么办?
问题:调试Java源代码时,只能看到源代码,却无法查看源代码中的变量的即时值 原因:jre为了节省空间,在打包时去掉了class文件中的调试信息. 思路:使用jdk里的src.zip源码重新编译生成完 ...
- ActiveMq持久化数据
A:持久化为文件 这个你装ActiveMQ时默认就是这种,只要你设置消息为持久化就可以了.涉及到的配置和代码有 <persistenceAdapter> <kahaDB direct ...
- go jwt OAuth2.0
https://blog.csdn.net/wangshubo1989/article/details/77980316 https://blog.csdn.net/wangshubo1989/art ...
- RedHat6.5-Linux安装telnet服务
1 下载以下三个包 telnet-0.17-47.el6.x86_64.rpm(telnet客户端) telnet-server-0.17-47.el6.x86_64.rpm(telnet服务端) x ...
- shell中判断是否是月末的方法
判断今天是不是一月的最后一天: 如果$(TZ=IST-32 date +%d)是1就是月末了.
- Elasticseach的评分机制
lucene 的评分机制 elasticsearch是基于lucene的,所以他的评分机制也是基于lucene的.评分就是我们搜索的短语和索引中每篇文档的相关度打分. 如果没有干预评分算法的时候,每次 ...
- (iOS)使用auto layout进行复杂布局时,UILabel的相关trick
本文转载至 http://blog.csdn.net/madongchunqiu/article/details/47960745 本文首发于CSDN:http://blog.csdn.net/ma ...
- php判断正常访问和外部访问
php判断正常访问和外部访问 <?php session_start(); if(isset($_POST['check'])&&!empty($_POST['name'])){ ...