安装hue及hadoop和hive整合

环境:

centos7

jdk1.8.0_111

Hadoop 2.7.3

Hive1.2.2

hue-3.10.0

Hue安装:

1.下载hue-3.10.0.tgz:

https://dl.dropboxusercontent.com/u/730827/hue/releases/3.10.0/hue-3.10.0.tgz

2.安装依赖包：

yum install libffi-devel
yum install gmp-devel
yum install python-devel mysql-devel
yum install ant gcc gcc-c++ rsync krb5-devel mysql openssl-devel cyrus-sasl-devel cyrus-sasl-gssapi sqlite-devel openldap-devel python-simplejson
yum install libtidy libxml2-devel libxslt-devel
yum install python-devel python-simplejson python-setuptools
yum install maven

3.编译Hue

tar -xzvf hue-3.10.0.tgz

cd hue-3.10.0

make apps

make install

Hue整合Hadoop:

　　HDFS:

　　hdfs-site.xml文件配置:

<property>
  <name>dfs.webhdfs.enabled</name>
  <value>true</value>
</property>

　　core-site.xml文件配置:

<property>
  <name>hadoop.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>hadoop.proxyuser.hue.groups</name>
  <value>*</value>
</property>

需要把修改过的hdfs-site.xml，core-site.xml文件分发到其他子节点上。

vi hue-3.10.0/desktop/conf/hue.ini

[hadoop]

  [[hdfs_clusters]]

    [[[default]]]

      # Enter the filesystem uri
      fs_defaultfs=hdfs://localhost:8020

      # Use WebHdfs/HttpFs as the communication mechanism.
      # Domain should be the NameNode or HttpFs host.
      webhdfs_url=http://localhost:50070/webhdfs/v1

　　YARN:

　　vi hue-3.10.0/desktop/conf/hue.ini

[hadoop]

  [[yarn_clusters]]

    [[[default]]]

      # Enter the host on which you are running the ResourceManager
      resourcemanager_host=localhost     

      # Whether to submit jobs to this cluster
      submit_to=True

      # URL of the ResourceManager API
      resourcemanager_api_url=http://localhost:8088

      # URL of the ProxyServer API
      proxy_api_url=http://localhost:8088

      # URL of the HistoryServer API
      history_server_api_url=http://localhost:19888

Hue整合Hive:

　　vi hue-3.10.0/desktop/conf/hue.ini

[beeswax]

  # Host where HiveServer2 is running.
  hive_server_host=localhost

  # Hive configuration directory, where hive-site.xml is located</span>
  hive_conf_dir=/etc/hive/conf

　　修改hive-site.xml配置:

<property>
    <name>hive.server2.thrift.bind.host</name>
    <value>localhost</value>
    <description>Bind host on which to run the HiveServer2 Thrift service.</description>
  </property>

　　启动hive服务:

$ bin/hive --service metastore

　　高能预警：matestore服务是Hive连接MySQL的metastore数据库用的。

$ bin/hive --service hiveserver2

　　高能预警：hiveserver2服务是通过JDBC访问Hive用的，默认端口是：10000。

启动Hue

　　build/env/bin/supervisor

在浏览器访问：http://192.168.187.128:8888打开Hue的Web 界面并登陆

参考:

http://www.opexlabs.com/2016/07/20/compiling-hue-centos-7/

http://gethue.com/how-to-configure-hue-in-your-hadoop-cluster/