Hive Over HBase

1. 在hbase上建测试表

hbase(main)::> create 'test_hive_over_hbase','f'
 row(s) in 2.5810 seconds

hbase(main)::> put 'test_hive_over_hbase','','f:DATA','2012|shaochen'
 row(s) in 0.2010 seconds

hbase(main)::> put 'test_hive_over_hbase','','f:DATA','2010|dachao'
 row(s) in 0.0100 seconds

hbase(main)::> put 'test_hive_over_hbase','','f:DATA','2013|qiuxin'
 row(s) in 0.0090 seconds

2.在Hive上建表

CREATE EXTERNAL TABLE hbase_test_hive_over_hbase(key int, value string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,f:DATA") TBLPROPERTIES ("hbase.table.name" = "test_hive_over_hbase");

注意由于表test_hive_over_hbase已经在hbase中存在，所以Hive中必须是EXTERNAL表.

3.在Hive对HBase测试表进行统计分析

select count(*) from hbase_test_hive_over_hbase where substring(value,,)='';

Total MapReduce jobs =
Launching Job  out of
Number of reduce tasks determined at compile time:
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapred.reduce.tasks=<number>
Starting Job = job_201312080251_0001, Tracking URL = http://jfp4-2:50030/jobdetails.jsp?jobid=job_201312080251_0001
Kill Command = /usr/lib/hadoop/libexec/../bin/hadoop job  -Dmapred.job.tracker=jfp4-: -kill job_201312080251_0001
Hadoop job information for Stage-: number of mappers: ; number of reducers:
-- ::, Stage- map = %,  reduce = %
-- ::, Stage- map = %,  reduce = %
-- ::, Stage- map = %,  reduce = %
Ended Job = job_201312080251_0001
MapReduce Jobs Launched:
Job : Map:   Reduce:    HDFS Read:  HDFS Write:  SUCCESS
Total MapReduce CPU Time Spent:  msec
OK

Time taken: 22.588 seconds