Hadoop_Hbase集群完全离线安装[CDH 5.13.1]

here

一、环境准备：（这儿准备了三台虚拟机：内存6-3-3）

JDK:
yum -y remove java java-1.6.-openjdk
rpm -e java-1.7.-openjdk-headless
rpm -e java-1.8.-openjdk-headless
yum install chkconfig python bind-utils psmisc libxslt zlib sqlite fuse fuse-libs redhat-lsb cyrus-sasl-plain cyrus-sasl-gssapi -y
vi /etc/profile
export JAVA_HOME=/usr/java/jdk1..0_162
export CLASSPATH=.:${JAVA_HOME}/lib
export PATH=${JAVA_HOME}/bin:$PATH

# vi /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=hadoop1

# cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::         localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.243.129 node-
192.168.243.133 node-
192.168.243.134 node-

# selinux关闭
setenforce
sed -i 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/selinux/config
sestatus

#  firewall
systemctl stop firewalld
systemctl disable firewalld

# NTP
http://blog.csdn.net/scorpio3k/article/details/49645219
systemctl restart ntpd
chkconfig --level  ntpd on

# SSH无密码登录配置
http://www.cnblogs.com/book-gary/p/5761268.html
ssh node- date;ssh node- date;ssh node- date

# ulimit -a
cat  /etc/security/limits.d/-nproc.conf
*          soft    nproc     unlimited
*          soft    nproc     unlimited
*          hard    nproc     unlimited
*          hard    nproc     unlimited
*          soft    nofile
*          hard    nofile    

# 降低虚拟内存需求率
cat /proc/sys/vm/swappiness
echo  > /proc/sys/vm/swappiness
永久降低虚拟内存需求率
echo 'vm.swappiness = 0' > /etc/sysctl.d/swappiness.conf
并运行如下命令使生效
sysctl -p

# 检查透明大页面
cat /sys/kernel/mm/transparent_hugepage/defrag
vi /etc/rc.local
echo never > /sys/kernel/mm/transparent_hugepage/defrag
echo never > /sys/kernel/mm/transparent_hugepage/enabled
chmod +x /etc/rc.d/rc.local

JDK和系统设置

二、安装mysql（参考 http://www.cnblogs.com/book-gary/p/5511628.html）

mysql -uroot -pbook_123321
set global validate_password_policy=0;
set global validate_password_length=4;
grant all privileges on *.* to 'scm'@'%' identified by 'me_123321';
flush privileges;
https://www.58jb.com/html/162.html

　　

三、下载CDH-5.13.1-1离线包

#cloudera-manager
cloudera-manager-centos7-cm5..1_x86_64.tar.gz

# cdh
CDH-5.13.-.cdh5.13.1.p0.-el7.parcel
CDH-5.13.-.cdh5.13.1.p0.-el7.parcel.sha1  //需要重命名，否则会重新下载
manifest.json

#
mysql-connector-java-5.1..tar.gz

四、安装Cloudera Manager Server 和Agent

参考http://blog.csdn.net/gtsina/article/details/78048925

关注如下操作：

cd /opt
tar -zxvf cloudera-manager-centos7-cm5..1_x86_64.tar.gz
#修改/opt/cm-5.13./etc/cloudera-scm-agent/config.ini中的server_host为主节点的主机名
vi /opt/cm-5.13./etc/cloudera-scm-agent/config.ini

cp mysql-connector-java-5.1.-bin.jar   /opt/cm-5.13./share/cmf/lib/
useradd --system --home=/opt/cm-5.13./run/cloudera-scm-server/ --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm
/opt/cm-5.13./share/cmf/schema/scm_prepare_database.sh mysql cm -hlocalhost -uroot -pbook_123321 --scm-host localhost scm book_123321 scm

tail -f /opt/cm-5.13./log/cloudera-scm-agent/cloudera-scm-agent.log
tail -f /opt/cm-5.13./log/cloudera-scm-server/cloudera-scm-server.log

/opt/cm-5.13./etc/init.d/cloudera-scm-server restart
#rm -f /opt/cm-5.13./lib/cloudera-scm-agent/cm_guid
/opt/cm-5.13./etc/init.d/cloudera-scm-agent restart

五、结果

$ ./hbase  shell
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/spark-billing/opt/hbase-1.3./lib/slf4j-log4j12-1.7..jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/spark-billing/opt/hadoop-2.7./share/hadoop/common/lib/slf4j-log4j12-1.7..jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 1.3., r930b9a55528fe45d8edce7af42fef2d35e77677a, Thu Apr   :: PDT 

hbase(main)::> status
 active master,  backup masters,  servers,  dead, 0.6667 average load

hbase(main)::> 

访问部署成功的Hbase

over！