基于Ambari的WebUI实现集群扩容案例

　　　　　　　　　　　　基于Ambari的WebUI实现集群扩容案例

　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　作者：尹正杰

版权声明：原创作品，谢绝转载！否则将追究法律责任。

一.将HDP的服务托管给Ambari服务

1>.点击“Service Auto Start”

2>.进入到"Server Auto Start"的管理界面

3>.勾选需要随着Ambari启动而启动的HDP服务组件

 4>.确认保存

二.扩容节点准备环境

1>.配置Ambari服务器与将要扩容的节点免密登录

[root@hdp101.yinzhengjie.org.cn ~]# ssh-copy-id root@hdp104.yinzhengjie.org.cn
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host 'hdp104.yinzhengjie.org.cn (172.200.1.104)' can't be established.
ECDSA key fingerprint is SHA256:y6iS5ipSyWSGRmgcjivbWhd78pKfrcuQHeBPd5H9/U8.
ECDSA key fingerprint is MD5:da:0f:2a::c0:d4:6e:7e::::f1::a7::.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO:  key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@hdp104.yinzhengjie.org.cn's password: 

Number of key(s) added: 

Now try logging into the machine, with:   "ssh 'root@hdp104.yinzhengjie.org.cn'"
and check to make sure that only the key(s) you wanted were added.

[root@hdp101.yinzhengjie.org.cn ~]#
[root@hdp101.yinzhengjie.org.cn ~]#
[root@hdp101.yinzhengjie.org.cn ~]# ssh root@hdp104.yinzhengjie.org.cn
Last login: Tue Feb  ::  from 172.200.0.1
[root@hdp104.yinzhengjie.org.cn ~]#
[root@hdp104.yinzhengjie.org.cn ~]# who
root     pts/        -- : (172.200.0.1)
root     pts/        -- : (172.200.1.101)
[root@hdp104.yinzhengjie.org.cn ~]#
[root@hdp104.yinzhengjie.org.cn ~]# exit
logout
Connection to hdp104.yinzhengjie.org.cn closed.
[root@hdp101.yinzhengjie.org.cn ~]#
[root@hdp101.yinzhengjie.org.cn ~]# who
root     pts/        -- : (172.200.0.1)
[root@hdp101.yinzhengjie.org.cn ~]#
[root@hdp101.yinzhengjie.org.cn ~]# 

[root@hdp101.yinzhengjie.org.cn ~]# ssh-copy-id root@hdp104.yinzhengjie.org.cn

2>.扩容节点配置chrony服务指向ambari服务器的时钟服务器

[root@hdp104.yinzhengjie.org.cn ~]# yum -y install chrony
Loaded plugins: fastestmirror
Determining fastest mirrors
 * base: mirrors.tuna.tsinghua.edu.cn
 * extras: mirrors.tuna.tsinghua.edu.cn
 * updates: mirrors.tuna.tsinghua.edu.cn
base                                                                                                                                                    | 3.6 kB  ::
extras                                                                                                                                                  | 2.9 kB  ::
updates                                                                                                                                                 | 2.9 kB  ::
(/): extras//x86_64/primary_db                                                                                                                       |  kB  ::
(/): updates//x86_64/primary_db                                                                                                                      | 6.7 MB  ::
Resolving Dependencies
--> Running transaction check
---> Package chrony.x86_64 :3.4-.el7 will be installed
--> Processing Dependency: libseccomp.so.()(64bit) for package: chrony-3.4-.el7.x86_64
--> Running transaction check
---> Package libseccomp.x86_64 :2.3.-.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

===============================================================================================================================================================================
 Package                                     Arch                                    Version                                       Repository                             Size
===============================================================================================================================================================================
Installing:
 chrony                                      x86_64                                  3.4-.el7                                     base                                   k
Installing for dependencies:
 libseccomp                                  x86_64                                  2.3.-.el7                                   base                                    k

Transaction Summary
===============================================================================================================================================================================
Install   Package (+ Dependent package)

Total download size:  k
Installed size:  k
Downloading packages:
(/): libseccomp-2.3.-.el7.x86_64.rpm                                                                                                                |   kB  ::
(/): chrony-3.4-.el7.x86_64.rpm                                                                                                                      |  kB  ::
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                          1.8 MB/s |  kB  ::
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : libseccomp-2.3.-.el7.x86_64                                                                                                                               /
  Installing : chrony-3.4-.el7.x86_64                                                                                                                                     /
  Verifying  : libseccomp-2.3.-.el7.x86_64                                                                                                                               /
  Verifying  : chrony-3.4-.el7.x86_64                                                                                                                                     / 

Installed:
  chrony.x86_64 :3.4-.el7                                                                                                                                                    

Dependency Installed:
  libseccomp.x86_64 :2.3.-.el7                                                                                                                                              

Complete!
[root@hdp104.yinzhengjie.org.cn ~]# 

[root@hdp104.yinzhengjie.org.cn ~]# yum -y install chrony

[root@hdp104.yinzhengjie.org.cn ~]# egrep -v "^#|^$" /etc/chrony.conf
server hdp101.yinzhengjie.org.cn iburst
driftfile /var/lib/chrony/drift
makestep 1.0
rtcsync
logdir /var/log/chrony
[root@hdp104.yinzhengjie.org.cn ~]#
[root@hdp104.yinzhengjie.org.cn ~]# systemctl restart chronyd
[root@hdp104.yinzhengjie.org.cn ~]# 

3>.将扩容节点的chrony服务设置为开机自启动

[root@hdp104.yinzhengjie.org.cn ~]# systemctl enable chronyd
[root@hdp104.yinzhengjie.org.cn ~]#
[root@hdp104.yinzhengjie.org.cn ~]# systemctl list-unit-files | grep chronyd
chronyd.service                               enabled
[root@hdp104.yinzhengjie.org.cn ~]# 

三.基于Ambari的WebUI将扩容节点加入现有集群

1>.点击"Hosts"，进入到主机的管理界面

2>.点击"Add New Hosts"

3>.填写目标主机和Ambari私钥(可以直接在Ambari服务中将私钥下载下来)信息

[root@hdp101.yinzhengjie.org.cn ~]# sz ~/.ssh/id_rsa

4>.等待安装完成

5>.等待主机检查

6>.主机检查完毕(若宿主机环境配置正常则检查主机时并不会有异样，可以自行查看检查结果)，点击下一步

7>.为扩容节点分配即将安装服务的角色

8>.分配配置群组(一般配置群组来管理不同节点的硬件配置，如果你生产环境中分配了多个组根据你的需求选择相应的分组即可)

9>.点击部署

10>.等待自动分配任务

11>.等待我们为扩容节点分配的角色服务安装完毕

12>.等待服务安装成功，点击下一步

13>.查看概要信息，并点击"COMPLETE"

14>.节点扩容成功