GreenPlum 大数据平台--安装
1. 环境准备
01, 安装包准备:
Greenplum : >>>>链接地址
Pgadmin客户端 : >>>链接地址
greenplum-cc-web监控: >>>>链接地址
02,节点说明
服务器ip | 主机名 | 角色 | 系统版本 |
192.168.0.221 | greenplum01 | master | centos7 |
192.168.0.222 | greenplum02 | Segment/standby | centos7 |
192.168.0.223 | greenplum03 | Segment | centos7 |
03,host文件配置(All)
echo -e "192.168.0.221 greenplum01\n192.168.0.222 greenplum02\n192.168.0.223 greenplum03" >>/etc/hosts scp /etc/hosts 192.168.0.222:/etc/hosts
scp /etc/hosts 192.168.0.223:/etc/hosts
04,创建用户(ALL)
[root@greenplum01 ~]# groupadd -g gpadmin
[root@greenplum01 ~]# useradd -g -m -d /home/gpadmin -s /bin/bash gpadmin
[root@greenplum01 ~]# passwd gpadmin
Changing password for user gpadmin.
New password:
BAD PASSWORD: The password is shorter than characters
Retype new password:
passwd: all authentication tokens updated successfully. [root@greenplum02 ~]# groupadd -g gpadmin
[root@greenplum02 ~]# useradd -g -m -d /home/gpadmin -s /bin/bash gpadmin
[root@greenplum02 ~]# passwd gpadmin
Changing password for user gpadmin.
New password:
BAD PASSWORD: The password is shorter than characters
Retype new password:
passwd: all authentication tokens updated successfully. [root@greenplum03 ~]# groupadd -g gpadmin
[root@greenplum03 ~]# useradd -g -m -d /home/gpadmin -s /bin/bash gpadmin
[root@greenplum03 ~]# passwd gpadmin
Changing password for user gpadmin.
New password:
BAD PASSWORD: The password is shorter than characters
Retype new password:
passwd: all authentication tokens updated successfully.
05,内核参数修改(ALL)
echo '
kernel.shmmax =
kernel.shmmni =
kernel.shmall =
kernel.sem =
kernel.sysrq =
kernel.core_uses_pid =
kernel.msgmnb =
kernel.msgmax =
kernel.msgmni =
net.ipv4.tcp_syncookies =
net.ipv4.ip_forward =
net.ipv4.conf.default.accept_source_route =
net.ipv4.tcp_tw_recycle =
net.ipv4.tcp_max_syn_backlog =
net.ipv4.conf.all.arp_filter =
net.ipv4.ip_local_port_range =
net.core.netdev_max_backlog =
net.core.rmem_max =
net.core.wmem_max =
vm.overcommit_memory =
'>>/etc/sysctl.conf
sysctl -
06.打开数限制(ALL)
echo '
* soft nofile
* hard nofile
* soft nproc
* hard nproc
'>>/etc/security/limits.conf
07,关闭防火墙,selinux(ALL)
systemctl disable firewalld.service
systemctl stop firewalld.service
setenforce
08,创建需要的目录(ALL)
mkdir /greenplum
chown -R gpadmin:gpadmin /greenplum
二,安装greenplum(master节点)
01,安装
[root@greenplum01 ~]# ls
anaconda-ks.cfg greenplum-cc-web-4.6.-LINUX-x86_64 initial-setup-ks.cfg Templates
Desktop greenplum-cc-web-4.6.-LINUX-x86_64.zip Music Videos
Documents greenplum-db-5.16.-rhel7-x86_64.rpm Pictures
Downloads Public
[root@greenplum01 ~]# rpm -ivh greenplum-db-5.16.-rhel7-x86_64.rpm
Preparing... ################################# [%]
Updating / installing...
:greenplum-db-5.16.- ################################# [%]
02,配置greeplum
chown -R gpadmin:gpadmin /usr/local/
su - gpadmin
mkdir -p /home/gpadmin/conf
vi /home/gpadmin/conf/hostlist
greenplum01
greenplum02
greenplum03
再创建一个seg_hosts ,包含所有的Segment Host的主机名:
vi /home/gpadmin/conf/seg_hosts
greenplum02
greenplum03
03,配置链接
[gpadmin@greenplum01 ~]$ source /usr/local/greenplum-db/greenplum_path.sh
[gpadmin@greenplum01 ~]$ gpssh-exkeys -f /home/gpadmin/conf/hostlist
[STEP of ] create local ID and authorize on local host [STEP of ] keyscan all hosts and update known_hosts file [STEP of ] authorize current user on remote hosts
... send to greenplum02
***
*** Enter password for greenplum02:
... send to greenplum03 [STEP of ] determine common authentication file content [STEP of ] copy authentication files to all remote hosts
... finished key exchange with greenplum02
... finished key exchange with greenplum03 [INFO] completed successfully
验证链接:
[gpadmin@greenplum01 ~]$ ssh greenplum02
[gpadmin@greenplum02 ~]$ exit
logout
Connection to greenplum02 clsed.
[gpadmin@greenplum01 ~]$ ssh greenplum03
[gpadmin@greenplum02 ~]$ exit
logout
Connection to greenplum03 clsed.
三,安装其他节点的DB
01,权限授予
chown -R gpadmin:gpadmin /usr/local
chown -R gpadmin:gpadmin /greenplum
02,数据打包
cd /usr/local
tar zcvf gp.tar greenplum-db-5.16./
gpscp -f /home/gpadmin/conf/seg_hosts gp.tar =:/usr/local/
03,解压缩
[gpadmin@greenplum01 ~]$ source /usr/local/greenplum-db/greenplum_path.sh
[gpadmin@greenplum01 ~]$ gpssh -f /home/gpadmin/conf/seg_hosts
=> cd /usr/local
[greenplum03]
[greenplum02]
=> tar -xf gp.tar
[greenplum03]
[greenplum02]
=> ln -s ./greenplum-db-5.16./ greenplum-db
[greenplum03]
[greenplum02]
=> ll
[greenplum03] total
[greenplum03] drwxr-xr-x. gpadmin gpadmin Nov bin
[greenplum03] drwxr-xr-x. gpadmin gpadmin Nov etc
[greenplum03] drwxr-xr-x. gpadmin gpadmin Nov games
[greenplum03] -rw-rw-r-- gpadmin gpadmin Mar : gp.tar
[greenplum03] lrwxrwxrwx gpadmin gpadmin Mar : greenplum-db -> ./greenplum-db-5.16./
[greenplum03] drwxr-xr-x gpadmin gpadmin Mar : greenplum-db-5.16.
[greenplum03] drwxr-xr-x. gpadmin gpadmin Nov include
[greenplum03] drwxr-xr-x. gpadmin gpadmin Nov lib
[greenplum03] drwxr-xr-x. gpadmin gpadmin Nov lib64
[greenplum03] drwxr-xr-x. gpadmin gpadmin Nov libexec
[greenplum03] drwxr-xr-x. gpadmin gpadmin Nov sbin
[greenplum03] drwxr-xr-x. gpadmin gpadmin Feb : share
[greenplum03] drwxr-xr-x. gpadmin gpadmin Nov src
[greenplum03] drwxrwxr-x gpadmin gpadmin Mar : usr
[greenplum02] total
[greenplum02] drwxr-xr-x. gpadmin gpadmin Nov bin
[greenplum02] drwxr-xr-x. gpadmin gpadmin Nov etc
[greenplum02] drwxr-xr-x. gpadmin gpadmin Nov games
[greenplum02] -rw-rw-r-- gpadmin gpadmin Mar : gp.tar
[greenplum02] lrwxrwxrwx gpadmin gpadmin Mar : greenplum-db -> ./greenplum-db-5.16./
[greenplum02] drwxr-xr-x gpadmin gpadmin Mar : greenplum-db-5.16.
[greenplum02] drwxr-xr-x. gpadmin gpadmin Nov include
[greenplum02] drwxr-xr-x. gpadmin gpadmin Nov lib
[greenplum02] drwxr-xr-x. gpadmin gpadmin Nov lib64
[greenplum02] drwxr-xr-x. gpadmin gpadmin Nov libexec
[greenplum02] drwxr-xr-x. gpadmin gpadmin Nov sbin
[greenplum02] drwxr-xr-x. gpadmin gpadmin Feb : share
[greenplum02] drwxr-xr-x. gpadmin gpadmin Nov src
[greenplum02] drwxrwxr-x gpadmin gpadmin Mar : usr
四,初始化数据库
01,创建需要的资源目录
[gpadmin@greenplum01 ~]$ source /usr/local/greenplum-db/greenplum_path.sh
[gpadmin@greenplum01 ~]$ gpssh -f /home/gpadmin/conf/hostlist
=> mkdir -p /greenplum/data/master
[greenplum01]
[greenplum02]
[greenplum03]
=> mkdir -p /greenplum/data/primary
[greenplum01]
[greenplum02]
[greenplum03]
=> mkdir -p /greenplum/data/mirror
[greenplum01]
[greenplum02]
[greenplum03]
=> mkdir -p /greenplum/data2/primary
[greenplum01]
[greenplum02]
[greenplum03]
=> mkdir -p /greenplum/data2/mirror
[greenplum01]
[greenplum02]
[greenplum03]
=>
02,节点配置环境(all)
[gpadmin@greenplum01 ~]$ vim .bash_profile
source /usr/local/greenplum-db/greenplum_path.sh
export MASTER_DATA_DIRECTORY=/greenplum/data/master/gpseg-
export GPPORT=
export PGDATABASE=gp_db
[gpadmin@greenplum01 ~]$ scp .bash_profile greenplum02:/home/gpadmin/
.bash_profile % .4KB/s :
[gpadmin@greenplum01 ~]$ scp .bash_profile greenplum03:/home/gpadmin/
.bash_profile % .8KB/s :
[gpadmin@greenplum01 ~]$ source .bash_profile
[gpadmin@greenplum02 ~]$ source .bash_profile
[gpadmin@greenplum03 ~]$ source .bash_profile
03,初始化检查
[gpadmin@greenplum01 ~]$ cd /usr/local/greenplum-db/bin/
[gpadmin@greenplum01 bin]$ gpcheckperf -f /home/gpadmin/conf/hostlist -r N -d /tmp
/usr/local/greenplum-db/./bin/gpcheckperf -f /home/gpadmin/conf/hostlist -r N -d /tmp -------------------
-- NETPERF TEST
------------------- ====================
== RESULT
====================
Netperf bisection bandwidth test
greenplum01 -> greenplum02 = 1654.370000
greenplum03 -> greenplum01 = 1156.950000
greenplum02 -> greenplum01 = 1183.980000
greenplum01 -> greenplum03 = 1363.620000 Summary:
sum = 5358.92 MB/sec
min = 1156.95 MB/sec
max = 1654.37 MB/sec
avg = 1339.73 MB/sec
median = 1363.62 MB/sec
04,创建初始化文件
[gpadmin@greenplum01 conf]$ cp /usr/local/greenplum-db/docs/cli_help/gpconfigs/gpinitsystem_config ./initgp_config
[gpadmin@greenplum01 conf]$ vim initgp_config
[gpadmin@greenplum01 conf]$ grep -Ev '^#|^$' initgp_config
ARRAY_NAME="Greenplum"
SEG_PREFIX=gpseg
PORT_BASE=
declare -a DATA_DIRECTORY=(/greenplum/data/primary /greenplum/data/primary /greenplum/data/primary /greenplum/data2/primary /greenplum/data2/primary /greenplum/data2/primary)
declare -a MIRROR_DATA_DIRECTORY=(/greenplum/data/mirror /greenplum/data/mirror /greenplum/data/mirror /greenplum/data2/mirror /greenplum/data2/mirror /greenplum/data2/mirror)
MASTER_HOSTNAME=greenplum01
MASTER_DIRECTORY=/greenplum/data/master
MASTER_PORT=
TRUSTED_SHELL=ssh
CHECK_POINT_SEGMENTS=
ENCODING=UNICODE
MIRROR_PORT_BASE=
REPLICATION_PORT_BASE=
MIRROR_REPLICATION_PORT_BASE=
MACHINE_LIST_FILE=/home/gpadmin/conf/seg_hosts
05,初始化
gpinitsystem -c /home/gpadmin/conf/initgp_config -s greenplum02
附上过程
[gpadmin@greenplum01 conf]$ gpinitsystem -c /home/gpadmin/conf/initgp_config -s greenplum02
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Checking configuration parameters, please wait...
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Reading Greenplum configuration file /home/gpadmin/conf/initgp_config
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Locale has not been set in /home/gpadmin/conf/initgp_config, will set to default value
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Locale set to en_US.utf8
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-No DATABASE_NAME set, will exit following template1 updates
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Checking configuration parameters, Completed
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Commencing multi-home checks, please wait...
..
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Configuring build for standard array
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Commencing multi-home checks, Completed
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Building primary segment instance array, please wait...
............
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Building group mirror array type , please wait...
............
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Checking Master host
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Checking new segment hosts, please wait...
........................
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Checking new segment hosts, Completed
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Greenplum Database Creation Parameters
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:---------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master Configuration
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:---------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master instance name = Greenplum
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master hostname = greenplum01
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master port =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master instance dir = /greenplum/data/master/gpseg-
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master LOCALE = en_US.utf8
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Greenplum segment prefix = gpseg
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master Database =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master connections =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master buffers = 128000kB
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Segment connections =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Segment buffers = 128000kB
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Checkpoint segments =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Encoding = UNICODE
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Postgres param file = Off
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Initdb to be used = /usr/local/greenplum-db/./bin/initdb
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-GP_LIBRARY_PATH is = /usr/local/greenplum-db/./lib
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-HEAP_CHECKSUM is = on
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-HBA_HOSTNAMES is =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Ulimit check = Passed
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Array host connect type = Single hostname per node
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master IP address [] = ::
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master IP address [] = 172.168.0.221
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master IP address [] = 192.168.0.221
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master IP address [] = fe80::58d2:b017::
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master IP address [] = fe80::5b46:68af::babe
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master IP address [] = fe80::6b83:cde0:ac33:87bf
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master IP address [] = fe80::b210:3bd4:b0c0:2e17
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master IP address [] = fe80::c0ae:2a2:82a5:5f12
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Master IP address [] = fe80::f144::68ac:
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Standby Master = greenplum02
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Primary segment # = 6
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Standby IP address = ::
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Standby IP address = 172.168.0.222
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Standby IP address = 192.168.0.222
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Standby IP address = fe80::58d2:b017::
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Standby IP address = fe80::5b46:68af::babe
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Standby IP address = fe80::6b83:cde0:ac33:87bf
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Standby IP address = fe80::b210:3bd4:b0c0:2e17
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Standby IP address = fe80::c0ae:2a2:82a5:5f12
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Standby IP address = fe80::f144::68ac:
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Total Database segments =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Trusted shell = ssh
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Number segment hosts =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Mirror port base =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Replicaton port base =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Mirror replicaton port base=
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Mirror segment # = 6
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Mirroring config = ON
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Mirroring type = Group
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:----------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Greenplum Primary Segment Configuration
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:----------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data/primary/gpseg0
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data/primary/gpseg1
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data/primary/gpseg2
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data2/primary/gpseg3
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data2/primary/gpseg4
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data2/primary/gpseg5
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data/primary/gpseg6
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data/primary/gpseg7
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data/primary/gpseg8
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data2/primary/gpseg9
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data2/primary/gpseg10
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data2/primary/gpseg11
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:---------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Greenplum Mirror Segment Configuration
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:---------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data/mirror/gpseg0
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data/mirror/gpseg1
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data/mirror/gpseg2
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data2/mirror/gpseg3
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data2/mirror/gpseg4
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum03 /greenplum/data2/mirror/gpseg5
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data/mirror/gpseg6
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data/mirror/gpseg7
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data/mirror/gpseg8
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data2/mirror/gpseg9
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data2/mirror/gpseg10
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-greenplum02 /greenplum/data2/mirror/gpseg11 Continue with Greenplum creation Yy|Nn (default=N):
> y
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Building the Master instance database, please wait...
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Starting the Master in admin mode
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Commencing parallel build of primary segment instances
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Spawning parallel processes batch [], please wait...
............
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Waiting for parallel processes batch [], please wait...
...................................
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:------------------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Parallel process exit status
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:------------------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Total processes marked as completed =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Total processes marked as killed =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Total processes marked as failed =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:------------------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Commencing parallel build of mirror segment instances
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Spawning parallel processes batch [], please wait...
............
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Waiting for parallel processes batch [], please wait...
...................
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:------------------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Parallel process exit status
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:------------------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Total processes marked as completed =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Total processes marked as killed =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Total processes marked as failed =
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:------------------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Deleting distributed backout files
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Removing back out file
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-No errors generated from parallel processes
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Restarting the Greenplum instance in production mode
:::: gpstop:greenplum01:gpadmin-[INFO]:-Starting gpstop with args: -a -l /home/gpadmin/gpAdminLogs -i -m -d /greenplum/data/master/gpseg-
:::: gpstop:greenplum01:gpadmin-[INFO]:-Gathering information and validating the environment...
:::: gpstop:greenplum01:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
:::: gpstop:greenplum01:gpadmin-[INFO]:-Obtaining Segment details from master...
:::: gpstop:greenplum01:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 5.16.0 build commit:23cec7df0406d69d6552a4bbb77035dba4d7dd44'
:::: gpstop:greenplum01:gpadmin-[INFO]:-There are connections to the database
:::: gpstop:greenplum01:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='immediate'
:::: gpstop:greenplum01:gpadmin-[INFO]:-Master host=greenplum01
:::: gpstop:greenplum01:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=immediate
:::: gpstop:greenplum01:gpadmin-[INFO]:-Master segment instance directory=/greenplum/data/master/gpseg-
:::: gpstop:greenplum01:gpadmin-[INFO]:-Attempting forceful termination of any leftover master process
:::: gpstop:greenplum01:gpadmin-[INFO]:-Terminating processes for segment /greenplum/data/master/gpseg-
:::: gpstart:greenplum01:gpadmin-[INFO]:-Starting gpstart with args: -a -l /home/gpadmin/gpAdminLogs -d /greenplum/data/master/gpseg-
:::: gpstart:greenplum01:gpadmin-[INFO]:-Gathering information and validating the environment...
:::: gpstart:greenplum01:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 5.16.0 build commit:23cec7df0406d69d6552a4bbb77035dba4d7dd44'
:::: gpstart:greenplum01:gpadmin-[INFO]:-Greenplum Catalog Version: '301705051'
:::: gpstart:greenplum01:gpadmin-[INFO]:-Starting Master instance in admin mode
:::: gpstart:greenplum01:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
:::: gpstart:greenplum01:gpadmin-[INFO]:-Obtaining Segment details from master...
:::: gpstart:greenplum01:gpadmin-[INFO]:-Setting new master era
:::: gpstart:greenplum01:gpadmin-[INFO]:-Master Started...
:::: gpstart:greenplum01:gpadmin-[INFO]:-Shutting down master
:::: gpstart:greenplum01:gpadmin-[INFO]:-Commencing parallel primary and mirror segment instance startup, please wait...
.....
:::: gpstart:greenplum01:gpadmin-[INFO]:-Process results...
:::: gpstart:greenplum01:gpadmin-[INFO]:-----------------------------------------------------
:::: gpstart:greenplum01:gpadmin-[INFO]:- Successful segment starts =
:::: gpstart:greenplum01:gpadmin-[INFO]:- Failed segment starts =
:::: gpstart:greenplum01:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) =
:::: gpstart:greenplum01:gpadmin-[INFO]:-----------------------------------------------------
:::: gpstart:greenplum01:gpadmin-[INFO]:-Successfully started of segment instances
:::: gpstart:greenplum01:gpadmin-[INFO]:-----------------------------------------------------
:::: gpstart:greenplum01:gpadmin-[INFO]:-Starting Master instance greenplum01 directory /greenplum/data/master/gpseg-
:::: gpstart:greenplum01:gpadmin-[INFO]:-Command pg_ctl reports Master greenplum01 instance active
:::: gpstart:greenplum01:gpadmin-[INFO]:-No standby master configured. skipping...
:::: gpstart:greenplum01:gpadmin-[INFO]:-Database successfully started
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Completed restart of Greenplum instance inproduction mode
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Starting initialization of standby master greenplum02
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Validating environment and parameters forstandby initialization...
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Checking for filespace directory /greenplum/data/master/gpseg- on greenplum02
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:------------------------------------------------------
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Greenplum standby master initialization parameters
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:------------------------------------------------------
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Greenplum master hostname =greenplum01
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Greenplum master data directory =/greenplum/data/master/gpseg-
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Greenplum master port =
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Greenplum standby master hostname =greenplum02
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Greenplum standby master port =
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Greenplum standby master data directory =/greenplum/data/master/gpseg-
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Greenplum update system catalog =On
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:------------------------------------------------------
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:- Filespace locations
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:------------------------------------------------------
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-pg_system -> /greenplum/data/master/gpseg-
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Syncing Greenplum Database extensions to standby
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-The packages on greenplum02 are consistent.
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Adding standby master to catalog...
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Database catalog updated successfully.
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Updating pg_hba.conf file...
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-pg_hba.conf files updated successfully.
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Updating filespace flat files...
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Filespace flat file updated successfully.
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Starting standby master
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Checking if standby master is running on host: greenplum02 in directory: /greenplum/data/master/gpseg-
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Cleaning up pg_hba.conf backup files...
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Backup files of pg_hba.conf cleaned up successfully.
:::: gpinitstandby:greenplum01:gpadmin-[INFO]:-Successfully created standby master on greenplum02
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Successfully completed standby master initialization
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Scanning utility log file for any warning messages
:::: gpinitsystem:greenplum01:gpadmin-[WARN]:-*******************************************************
:::: gpinitsystem:greenplum01:gpadmin-[WARN]:-Scan of log file indicates that some warnings or errors
:::: gpinitsystem:greenplum01:gpadmin-[WARN]:-were generated during the array creation
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Please review contents of log file
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-/home/gpadmin/gpAdminLogs/gpinitsystem_20190313.log
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-To determine level of criticality
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-These messages could be from a previous run of the utility
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-that was called today!
:::: gpinitsystem:greenplum01:gpadmin-[WARN]:-*******************************************************
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Greenplum Database instance successfully created
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-------------------------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-To complete the environment configuration,please
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-update gpadmin .bashrc file with the following
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-. Ensure that the greenplum_path.sh file is sourced
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-. Add "export MASTER_DATA_DIRECTORY=/greenplum/data/master/gpseg-1"
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:- to access the Greenplum scripts for this instance:
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:- or, use -d /greenplum/data/master/gpseg- option for the Greenplum scripts
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:- Example gpstate -d /greenplum/data/master/gpseg-
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Script log file = /home/gpadmin/gpAdminLogs/gpinitsystem_20190313.log
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-To remove instance, run gpdeletesystem utility
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Standby Master greenplum02 has been configured
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-To activate the Standby Master Segment in the event of Master
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-failure review options for gpactivatestandby
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-------------------------------------------------------
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-The Master /greenplum/data/master/gpseg-/pg_hba.conf post gpinitsystem
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-has been configured to allow all hosts within this new
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-array to intercommunicate. Any hosts external to this
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-new array must be explicitly added to thisfile
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-Refer to the Greenplum Admin support guidewhich is
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-located in the /usr/local/greenplum-db/./docs directory
:::: gpinitsystem:greenplum01:gpadmin-[INFO]:-------------------------------------------------------
安装完毕
简单使用:
standby 检查
GreenPlum 大数据平台--安装的更多相关文章
- GreenPlum 大数据平台--介绍
一,GreenPlum 01,介绍: Greenplum是一种基于PostgreSQL的分布式数据库,其采用shared-nothing架构,主机.操作系统.内存.存储都是自我控制的,不存在共享. 官 ...
- GreenPlum 大数据平台--监控
数据库状态监控活动 活动 过程 纠正措施 列出当前状态为down的Segment.如果有任何行被返回,就会生成一个警告或者告警. 推荐频率:每5到10分钟 重要度: IMPORTANT 在postgr ...
- GreenPlum 大数据平台--外部表(三)
一,外部表介绍 Greenplum 在数据加载上有一个明显的优势,就是支持数据的并发加载,gpfdisk是并发加载的工具,数据库中对应的就是外部表 所谓外部表,就是在数据库中只有表定义.没有数据,数据 ...
- GreenPlum 大数据平台--运维(三)
一,操作命令 01,启动gpstart 参数说明 COMMAND NAME: gpstart Starts a Greenplum Database system. ***************** ...
- GreenPlum 大数据平台--非并行备份(六)
一,非并行备份(pg_dump) 1) GP依然支持常规的PostgreSQL备份命令pg_dump和pg_dumpall 2) 备份将在Master主机上创建一个包含所有Segment数据的大的备份 ...
- 最新版大数据平台安装部署指南,HDP-2.6.5.0,ambari-2.6.2.0
一.服务器环境配置 1 系统要求 名称 地址 操作系统 root密码 Master1 10.1.0.30 Centos 7.7 Root@bidsum1 Master2 10.1.0.105 Cent ...
- GreenPlum 大数据平台--备份-邮件配置-gpcrondump & gpdbrestore(五)
01,备份 生成备份数据库 [gpadmin@greenplum01 ~]$ gpcrondump -l /gpbackup/back2/gpcorndump.log -x postgres -v [ ...
- GreenPlum 大数据平台--并行备份(四)
01,并行备份(gp_dump) 1) GP同时备份Master和所有活动的Segment实例 2) 备份消耗的时间与系统中实例的数量没有关系 3) 在Master主机上备份所有DDL文件和GP相关的 ...
- GreenPlum 大数据平台--基础使用(一)
一,操作语法 01,创建数据库 --创建用户-- [gpadmin@greenplum01 ~]$ export PGDATABASE=testDB --指定数据库名字 [gpadmin@greenp ...
随机推荐
- Java web 三层架构 模拟图
- 解决Tomcat错误信息:No 'Access-Control-Allow-Origin' header is present on the requested resource | Solving Tomcat Error: No 'Access-Control-Allow-Origin' header is present on the requested resource
最近在使用GeoServer调用Vector Tile服务时,经常会显示不出来结果.打开浏览器调试台,发现报No 'Access-Control-Allow-Origin' header is pre ...
- POJ - 2586 Y2K Accounting Bug (找规律)
Accounting for Computer Machinists (ACM) has sufferred from the Y2K bug and lost some vital data for ...
- Django不能使用ip方式访问的解决办法
问题: 启动服务后,使用http://127.0.0.1:8000/showcase/或者http://localhost:8000/showcase/都能访问, 但是使用http://192.168 ...
- window.document 对象
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/ ...
- C#构造函数详解和析构函数详解
首先来了解下构造函数的定义: C#构造函数是一种特殊的成员函数,它的作用主要用于为对象分配存储空间,对数据成员进行初始化. 接下来看一下他的语法定义形式: |访问修饰符| 标识符 (|参数列表|) | ...
- java并发编程(更新)
概念理解:①串行程序②并发程序: 线程安全问题: 同一进程中的所有线程共享进程中的内存地址空间.如果没有明确的同步机制来管理共享数据,那么当一个线程正在使用某个变量时,另一个线程可能同时访问这个变量, ...
- JSON Path表达式
JSON Path 描述 $ 表示根元素 @ 表示当前节点 . 表示子节点 .. 选择所有符合条件的节点 * 所有节点 [] 迭代器标识,如数组下标 [,] 支持迭代器中多选 [start:en ...
- VIN-Fusion config with Realsense D435i
### First shot Copy the .launch file in package VINS-Fusion to the directory of realsense2_cameara/l ...
- mybatis 学习笔记(一):mybatis 初认识
mybatis 学习笔记(一):mybatis 初认识 简介 MyBatis是一个Java持久层框架,它通过XML描述符或注解把对象与存储过程或SQL语句关联起来.mybatis 可以将 prepar ...