Greenplum 添加mirror步骤
原文链接:https://yq.aliyun.com/articles/695864
[TOC]
概述
新安装的greenplum集群只有primary节点,没有mirror。高可用性没得到保证。所以就需要为集群添加mirror节点
注意:数据量过大时添加mirror,会有较大的磁盘压力,因为后台会一直同步数据,这一点线上系统需要注意
添加前情况
初始化的时候只有primary
gpstate -b
- 20190326:00:48:33:005423 gpinitsystem:gw_mdw1:gpadmin-[INFO]:-Greenplum Primary Segment Configuration
- 20190326:00:48:33:005423 gpinitsystem:gw_mdw1:gpadmin-[INFO]:----------------------------------------
- 20190326:00:48:33:005423 gpinitsystem:gw_mdw1:gpadmin-[INFO]:-gw_sdw1 /data/primary/gpseg0 40000 2 0
- 20190326:00:48:33:005423 gpinitsystem:gw_mdw1:gpadmin-[INFO]:-gw_sdw1 /data/primary/gpseg1 40001 3 1
- 20190326:00:48:33:005423 gpinitsystem:gw_mdw1:gpadmin-[INFO]:-gw_sdw1 /data/primary/gpseg2 40002 4 2
- 20190326:00:48:33:005423 gpinitsystem:gw_mdw1:gpadmin-[INFO]:-gw_sdw1 /data/primary/gpseg3 40003 5 3
- 20190326:00:48:33:005423 gpinitsystem:gw_mdw1:gpadmin-[INFO]:-gw_sdw2 /data/primary/gpseg4 40000 6 4
- 20190326:00:48:33:005423 gpinitsystem:gw_mdw1:gpadmin-[INFO]:-gw_sdw2 /data/primary/gpseg5 40001 7 5
- 20190326:00:48:33:005423 gpinitsystem:gw_mdw1:gpadmin-[INFO]:-gw_sdw2 /data/primary/gpseg6 40002 8 6
- 20190326:00:48:33:005423 gpinitsystem:gw_mdw1:gpadmin-[INFO]:-gw_sdw2 /data/primary/gpseg7 40003 9 7
- Continue with Greenplum creation Yy/Nn>
查看系统配置表,发现只有primary节点
- postgres=# SELECT * from gp_segment_configuration ;
- dbid | content | role | preferred_role | mode | status | port | hostname | address | replication_port | san_mounts
- ------+---------+------+----------------+------+--------+-------+----------+---------+------------------+------------
- 1 | -1 | p | p | s | u | 5432 | gw_mdw1 | gw_mdw1 | |
- 2 | 0 | p | p | s | u | 40000 | gw_sdw1 | gw_sdw1 | |
- 6 | 4 | p | p | s | u | 40000 | gw_sdw2 | gw_sdw2 | |
- 3 | 1 | p | p | s | u | 40001 | gw_sdw1 | gw_sdw1 | |
- 7 | 5 | p | p | s | u | 40001 | gw_sdw2 | gw_sdw2 | |
- 4 | 2 | p | p | s | u | 40002 | gw_sdw1 | gw_sdw1 | |
- 8 | 6 | p | p | s | u | 40002 | gw_sdw2 | gw_sdw2 | |
- 5 | 3 | p | p | s | u | 40003 | gw_sdw1 | gw_sdw1 | |
- 9 | 7 | p | p | s | u | 40003 | gw_sdw2 | gw_sdw2 | |
- (9 rows)
添加步骤
在所有需要添加mirror的主机,创建存放mirror的数据目录
可以使用gpssh命令
gpssh -f seg_hosts -e 'mkdir -p /data/mirror'
生成addmirror文件
执行gpaddmirrors 命令,键入存放mirror节点的日志,生成配置文件
- [gpadmin@gw_mdw1 ~]$ gpaddmirrors -o ./addmirror
- 20190326:00:56:21:030831 gpaddmirrors:gw_mdw1:gpadmin-[INFO]:-Starting gpaddmirrors with args: -o ./addmirror
- 20190326:00:56:21:030831 gpaddmirrors:gw_mdw1:gpadmin-[INFO]:-local Greenplum Version: 'postgres (Greenplum Database) 4.3.1.0 build 6'
- 20190326:00:56:21:030831 gpaddmirrors:gw_mdw1:gpadmin-[INFO]:-master Greenplum Version: 'PostgreSQL 8.2.15 (Greenplum Database 4.3.1.0 build 6) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.4.2 compiled on Jun 11 2014 17:23:40'
- 20190326:00:56:21:030831 gpaddmirrors:gw_mdw1:gpadmin-[INFO]:-Obtaining Segment details from master...
- Enter mirror segment data directory location 1 of 4 >
- /data/mirror
- Enter mirror segment data directory location 2 of 4 >
- /data/mirror
- Enter mirror segment data directory location 3 of 4 >
- /data/mirror
- Enter mirror segment data directory location 4 of 4 >
- /data/mirror
- 20190326:00:57:15:030831 gpaddmirrors:gw_mdw1:gpadmin-[INFO]:-Configuration file output to ./addmirror successfully.
查看文件内容如下
- [gpadmin@gw_mdw1 ~]$ cat addmirror
- filespaceOrder=
- mirror0=0:gw_sdw2:41000:42000:43000:/data/mirror/gpseg0
- mirror1=1:gw_sdw2:41001:42001:43001:/data/mirror/gpseg1
- mirror2=2:gw_sdw2:41002:42002:43002:/data/mirror/gpseg2
- mirror3=3:gw_sdw2:41003:42003:43003:/data/mirror/gpseg3
- mirror4=4:gw_sdw1:41000:42000:43000:/data/mirror/gpseg4
- mirror5=5:gw_sdw1:41001:42001:43001:/data/mirror/gpseg5
- mirror6=6:gw_sdw1:41002:42002:43002:/data/mirror/gpseg6
- mirror7=7:gw_sdw1:41003:42003:43003:/data/mirror/gpseg7
执行添加命令
- [gpadmin@gw_mdw1 ~]$ gpaddmirrors -i addmirror
- 20190326:01:08:45:031106 gpaddmirrors:gw_mdw1:gpadmin-[INFO]:-Starting gpaddmirrors with args: -i addmirror
- 20190326:01:08:45:031106 gpaddmirrors:gw_mdw1:gpadmin-[INFO]:-local Greenplum Version: 'postgres (Greenplum Database) 4.3.1.0 build 6'
- 20190326:01:08:45:031106 gpaddmirrors:gw_mdw1:gpadmin-[INFO]:-master Greenplum Version: 'PostgreSQL 8.2.15 (Greenplum Database 4.3.1.0 build 6) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.4.2 compiled on Jun 11 2014 17:23:40'
命令没有报错,查看mirror节点的情况
使用gpstate -m查看,发现所有的mirror正在同步数据,因为我的集群新建,很快就同步完成了,此时再执行gpstate -m就可以看到Data Status的状态是Synchronized(已同步的)
- [gpadmin@gw_mdw1 ~]$ gpstate -m
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:-Starting gpstate with args: -m
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:-local Greenplum Version: 'postgres (Greenplum Database) 4.3.1.0 build 6'
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:-master Greenplum Version: 'PostgreSQL 8.2.15 (Greenplum Database 4.3.1.0 build 6) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.4.2 compiled on Jun 11 2014 17:23:40'
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:-Obtaining Segment details from master...
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:--------------------------------------------------------------
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:--Current GPDB mirror list and status
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:--Type = Group
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:--------------------------------------------------------------
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:- Mirror Datadir Port Status Data Status
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:- gw_sdw2 /data/mirror/gpseg0 41000 Passive Resynchronizing
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:- gw_sdw2 /data/mirror/gpseg1 41001 Passive Resynchronizing
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:- gw_sdw2 /data/mirror/gpseg2 41002 Passive Resynchronizing
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:- gw_sdw2 /data/mirror/gpseg3 41003 Passive Resynchronizing
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:- gw_sdw1 /data/mirror/gpseg4 41000 Passive Resynchronizing
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:- gw_sdw1 /data/mirror/gpseg5 41001 Passive Resynchronizing
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:- gw_sdw1 /data/mirror/gpseg6 41002 Passive Resynchronizing
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:- gw_sdw1 /data/mirror/gpseg7 41003 Passive Resynchronizing
- 20190326:01:09:51:031359 gpstate:gw_mdw1:gpadmin-[INFO]:--------------------------------------------------------------
查看节点状态
发现所有的mirror已经启动
- postgres=# SELECT * from gp_segment_configuration ;
- dbid | content | role | preferred_role | mode | status | port | hostname | address | replication_port | san_mounts
- ------+---------+------+----------------+------+--------+-------+----------+---------+------------------+------------
- 1 | -1 | p | p | s | u | 5432 | gw_mdw1 | gw_mdw1 | |
- 2 | 0 | p | p | s | u | 40000 | gw_sdw1 | gw_sdw1 | 43000 |
- 10 | 0 | m | m | s | u | 41000 | gw_sdw2 | gw_sdw2 | 42000 |
- 3 | 1 | p | p | s | u | 40001 | gw_sdw1 | gw_sdw1 | 43001 |
- 11 | 1 | m | m | s | u | 41001 | gw_sdw2 | gw_sdw2 | 42001 |
- 4 | 2 | p | p | s | u | 40002 | gw_sdw1 | gw_sdw1 | 43002 |
- 12 | 2 | m | m | s | u | 41002 | gw_sdw2 | gw_sdw2 | 42002 |
- 5 | 3 | p | p | s | u | 40003 | gw_sdw1 | gw_sdw1 | 43003 |
- 13 | 3 | m | m | s | u | 41003 | gw_sdw2 | gw_sdw2 | 42003 |
- 6 | 4 | p | p | s | u | 40000 | gw_sdw2 | gw_sdw2 | 43000 |
- 14 | 4 | m | m | s | u | 41000 | gw_sdw1 | gw_sdw1 | 42000 |
- 7 | 5 | p | p | s | u | 40001 | gw_sdw2 | gw_sdw2 | 43001 |
- 15 | 5 | m | m | s | u | 41001 | gw_sdw1 | gw_sdw1 | 42001 |
- 8 | 6 | p | p | s | u | 40002 | gw_sdw2 | gw_sdw2 | 43002 |
- 16 | 6 | m | m | s | u | 41002 | gw_sdw1 | gw_sdw1 | 42002 |
- 9 | 7 | p | p | s | u | 40003 | gw_sdw2 | gw_sdw2 | 43003 |
- 17 | 7 | m | m | s | u | 41003 | gw_sdw1 | gw_sdw1 | 42003 |
- (17 rows)
Greenplum 添加mirror步骤的更多相关文章
- Deepgreen/Greenplum 删除节点步骤
Deepgreen/Greenplum删除节点步骤 Greenplum和Deepgreen官方都没有给出删除节点的方法和建议,但实际上,我们可以对节点进行删除.由于不确定性,删除节点极有可能导致其他的 ...
- pytest文档38-allure.setp添加测试用例步骤
前言 一般流程性的测试用例,写成自动化用例时,步骤较多写起来会比较长.在测试用例里面添加详细的步骤有助于更好的阅读,也方便报错后快速的定位到问题. 举个常见的测试场景用例:从登陆开始,到浏览商品添加购 ...
- 01 Mybatis框架添加英雄步骤
客户端发出请求的几种方式 通过浏览器的地址栏中发出请求 通过html页面中的超链接发出请求 通过html页面中的form表单发出请求 通过前端框架发出请求 工程中使用数据库需要做的几件事: 在pom. ...
- oneThink后台添加插件步骤详解
内容管理框架:oneThink 版本:V1.1.141212 (注:v1.1也有很多版本,一不小心就下到V1.1.140202 去了,还有其他版本,建议去代码托管平台下载最新版本) 我也不偷懒,把每一 ...
- 【转】Hadoop集群添加磁盘步骤
转自:http://blog.csdn.net/huyuxiang999/article/details/17691405 一.实验环境 : 1.硬件:3台DELL服务器,CPU:2.27GHz*16 ...
- ASP.NET Core 添加区域步骤(详细)
1 前言 早就想总结一下,但是没时间,这次有时间了,就详细的把步骤写出来. 2 步骤 2.1 添加区域 右键项目->添加->区域,如图1: 区域名称:Ceshi 添加完之后解决方案管理器会 ...
- linux操作系统不重启添加raid0步骤
1.限制:本步骤仅适用于LSI芯片的raid卡,可以通过以下蓝色指令判断是否LSI芯片 [root@HKC-Lab-CDN ~]# lspci | grep -i lsi 03:00.0 RAID b ...
- 阿里云移动推送 ios项目添加SDK步骤
添加阿里云Pods仓库和各产品SDK Pod依赖,配置步骤如下: 1. CocoaPods集成添加阿里云Pods仓库,Podfile添加: source 'https://github.com/ali ...
- 阿里云移动推送 安卓项目添加SDK步骤
Gradle的Emas服务插件会加载您下载的 aliyun-emas-services.json 文件.请修改工程的build.gradle使用该插件.配置步骤如下: 1. 修改项目级目录下build ...
随机推荐
- Python属性的查找顺序
属性查找顺序 关于属性描述符请看上文>属性描述符 在梳理属性查找相关知识时,查看了很多的书籍和他人的博客,发现很多讲的过于抽象,并没有一个清晰的流程呈现.特此写下我对于此方面的理解和总结. ...
- Django模型层之ORM
Django模型层之ORM操作 一 ORM简介 我们在使用Django框架开发web应用的过程中,不可避免地会涉及到数据的管理操作(如增.删.改.查),而一旦谈到数据的管理操作,就需要用到数据库管理软 ...
- Selenium_css 元素定位
1.通过id定位 # 代表id driver.find_element_by_css_selector("#kw").send_keys("hao" ...
- docker-compose 单机容器编排
docker-compose用来在单机上编排容器(定义和运行多个容器,使容器能互通) docker-compose将所管理的容器分为3层结构:project service container d ...
- Springboot 结合百度IORC实现自定义模板图片识别
前言: 首先呢,最近再公司的项目当中遇到这样的一个问题,就是需要识别图片,提取图片当中的关键语句,而且识别的语句当然是人家手写体识别,翻来覆去一想,最终还是决定使用百度的OCR帮助我解决这一项需求 话 ...
- RESTful 的学习总结
RESTful 的核心思想就是,客户端发出的数据操作指令都是"动词 + 宾语"的结构.比如,GET /articles这个命令,GET是动词,/articles是宾语.动词通常就是 ...
- C# CheckBoxList绑定值,设置及获取
前端页面:.aspx <asp:CheckBoxList ID="ckbdot" runat="server" RepeatDirection=" ...
- kubernetes第五章--创建资源的两种方式
- tensorflow 单机多GPU训练时间比单卡更慢/没有很大时间上提升
使用tensorflow model库里的cifar10 多gpu训练时,最后测试发现时间并没有减少,反而更慢 参考以下两个链接 https://github.com/keras-team/keras ...
- Delphi - 程序运行时不显示主窗体
// 不显示主窗体 Application.ShowMainForm := False;