MySQL5.7版本单节点大数据量迁移到PXC8.0版本集群全记录-3
接上文,单节点升级到80版本之后,构建新版本的80集群就水到渠成、相对简单了,详情可参见之前的集群构建博文。
本文在修改配置集群的新参数时,修改了pxc_strict_mode为默认的ENFORCING,注释掉skip_ssl以支持SSL加密同步传输。
donor节点的日志如下:
2021-12-07T12:21:56.351545Z 0 [Note] [MY-000000] [WSREP-SST] Streaming the backup to joiner at 10.124.206.18 4444
2021-12-07T13:06:19.710146Z 0 [Note] [MY-000000] [Galera] SST sent: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:19.710196Z 0 [Note] [MY-000000] [WSREP] Server status change donor -> joined
2021-12-07T13:06:19.710224Z 0 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:19.710565Z 0 [Note] [MY-000000] [Galera] 0.0 (mysqldb2): State transfer to 1.0 (mysqldb1) complete.
2021-12-07T13:06:19.710605Z 0 [Note] [MY-000000] [Galera] Shifting DONOR/DESYNCED -> JOINED (TO: 5)
2021-12-07T13:06:19.710815Z 0 [Note] [MY-000000] [Galera] Member 0.0 (mysqldb2) synced with group.
2021-12-07T13:06:19.710832Z 0 [Note] [MY-000000] [Galera] Shifting JOINED -> SYNCED (TO: 5)
2021-12-07T13:06:19.710890Z 10 [Note] [MY-000000] [Galera] Server mysqldb2 synced with group
2021-12-07T13:06:19.710931Z 10 [Note] [MY-000000] [WSREP] Server status change joined -> synced
2021-12-07T13:06:19.710944Z 10 [Note] [MY-000000] [WSREP] Synchronized with group, ready for connections
2021-12-07T13:06:19.710963Z 10 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.990181Z 0 [Note] [MY-000000] [Galera] async IST sender served
2021-12-07T13:06:38.990751Z 0 [Note] [MY-000000] [Galera] 1.0 (mysqldb1): State transfer from 0.0 (mysqldb2) complete.
2021-12-07T13:06:38.990963Z 0 [Note] [MY-000000] [Galera] Member 1.0 (mysqldb1) synced with group.
joiner节点的日志如下:
2021-12-07T12:21:46.624809Z 0 [Note] [MY-000000] [WSREP-SST] Proceeding with SST.........
2021-12-07T12:21:46.663620Z 0 [Note] [MY-000000] [WSREP-SST] ............Waiting for SST streaming to complete!
2021-12-07T12:21:47.528091Z 0 [Note] [MY-000000] [Galera] (3d6299de-a13c, 'ssl://0.0.0.0:4567') turning message relay requesting off
2021-12-07T13:06:19.710726Z 0 [Note] [MY-000000] [Galera] 0.0 (mysqldb2): State transfer to 1.0 (mysqldb1) complete.
2021-12-07T13:06:19.711254Z 0 [Note] [MY-000000] [Galera] Member 0.0 (mysqldb2) synced with group.
2021-12-07T13:06:19.712860Z 0 [Note] [MY-000000] [WSREP-SST] Preparing the backup at /u01/mysql/data//sst-xb-tmpdir
2021-12-07T13:06:32.139859Z 0 [Note] [MY-000000] [WSREP-SST] Moving the backup to /u01/mysql/data/
2021-12-07T13:06:32.265350Z 0 [Note] [MY-000000] [WSREP-SST] Running post-processing...........
2021-12-07T13:06:32.271818Z 0 [Note] [MY-000000] [WSREP-SST] Skipping mysql_upgrade (sst): local version (8.0.23) == donor version (8.0.23)
2021-12-07T13:06:32.363903Z 0 [Note] [MY-000000] [WSREP-SST] Waiting for server instance to start..... This may take some time
2021-12-07T13:06:37.080878Z 0 [Note] [MY-000000] [WSREP-SST] ...........post-processing done
2021-12-07T13:06:37.082170Z 0 [Note] [MY-000000] [WSREP-SST] Galera co-ords from recovery: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:37.110761Z 3 [Note] [MY-000000] [Galera] Processing SST received
2021-12-07T13:06:37.111352Z 3 [Note] [MY-000000] [WSREP] Server status change joiner -> initializing
2021-12-07T13:06:37.111828Z 3 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:37.113486Z 0 [Warning] [MY-013245] [Server] The SSL library function CRYPTO_set_mem_functions failed. This is typically caused by the SSL library already being used. As a result the SSL memory allocation will not be instrumented.
2021-12-07T13:06:37.119056Z 4 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-12-07T13:06:38.516689Z 4 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2021-12-07T13:06:38.791539Z 4 [Note] [MY-000000] [WSREP] wsrep_init_schema_and_SR (nil)
2021-12-07T13:06:38.803764Z 4 [System] [MY-000000] [WSREP] PXC upgrade completed successfully
2021-12-07T13:06:38.820853Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /var/lib/mysql/mysqlx.sock
2021-12-07T13:06:38.821518Z 0 [Warning] [MY-013129] [Server] A message intended for a client cannot be sent there as no client-session is attached. Therefore, we're sending the information to the error-log instead: MY-001287 - 'validate password plugin' is deprecated and will be removed in a future release. Please use validate_password component instead
2021-12-07T13:06:38.933070Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
2021-12-07T13:06:38.933778Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel.
2021-12-07T13:06:38.951187Z 0 [Warning] [MY-010324] [Server] 'db' entry 'percona_schema mysql.pxc.sst.role@localhost' had database in mixed case that has been forced to lowercase because lower_case_table_names is set. It will not be possible to remove this privilege using REVOKE.
2021-12-07T13:06:38.966474Z 0 [Note] [MY-000000] [WSREP] Initialized wsrep sidno 4
2021-12-07T13:06:38.967977Z 0 [Note] [MY-000000] [Galera] Server initialized
2021-12-07T13:06:38.968748Z 0 [Note] [MY-000000] [WSREP] Server status change initializing -> initialized
2021-12-07T13:06:38.969468Z 0 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.970219Z 3 [Note] [MY-000000] [WSREP] Server status change initialized -> joined
2021-12-07T13:06:38.971005Z 3 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.971772Z 3 [Note] [MY-000000] [Galera] Recovered position from storage: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.982982Z 3 [Note] [MY-000000] [Galera] Recovered view from SST:
id: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
status: primary
protocol_version: 4
capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
final: no
own_index: 1
members(2):
0: 1ad4eb4c-5757-11ec-a746-e3cb8800c1e0, mysqldb2
1: 3d6299de-5758-11ec-a13c-63e7397f116a, mysqldb1
2021-12-07T13:06:38.986279Z 3 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.986499Z 10 [Note] [MY-000000] [WSREP] Recovered cluster id 2865d710-5743-11ec-8f0c-7af1fec7bcb1
2021-12-07T13:06:38.986556Z 11 [Note] [MY-000000] [WSREP] Starting applier thread 11
2021-12-07T13:06:38.986584Z 12 [Note] [MY-000000] [WSREP] Starting applier thread 12
2021-12-07T13:06:38.986631Z 13 [Note] [MY-000000] [WSREP] Starting applier thread 13
2021-12-07T13:06:38.986647Z 14 [Note] [MY-000000] [WSREP] Starting applier thread 14
2021-12-07T13:06:38.986673Z 15 [Note] [MY-000000] [WSREP] Starting applier thread 15
2021-12-07T13:06:38.986727Z 17 [Note] [MY-000000] [WSREP] Starting applier thread 17
2021-12-07T13:06:38.986841Z 16 [Note] [MY-000000] [WSREP] Starting applier thread 16
2021-12-07T13:06:38.987236Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.23-14.1' socket: '/u01/mysql/mysql.sock' port: 3306 Percona XtraDB Cluster (GPL), Release rel14, Revision d3b9a1d, WSREP version 26.4.3.
2021-12-07T13:06:38.988606Z 3 [Note] [MY-000000] [Galera] SST received: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.988640Z 3 [System] [MY-000000] [WSREP] SST completed
2021-12-07T13:06:38.988688Z 1 [Note] [MY-000000] [Galera] str_proto_ver_: 3 sst_seqno_: 5 cc_seqno: 5 req->ist_len(): 67
2021-12-07T13:06:38.988741Z 1 [Note] [MY-000000] [Galera] Installed new state from SST: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.989082Z 1 [Note] [MY-000000] [Galera] Cert. index preload up to 5
2021-12-07T13:06:38.989159Z 0 [Note] [MY-000000] [Galera] ####### IST applying starts with 6
2021-12-07T13:06:38.989326Z 0 [Note] [MY-000000] [Galera] ####### IST current seqno initialized to 5
2021-12-07T13:06:38.989412Z 0 [Note] [MY-000000] [Galera] Receiving IST... 0.0% (0/1 events) complete.
2021-12-07T13:06:38.989434Z 0 [Note] [MY-000000] [Galera] IST preload starting at 5
2021-12-07T13:06:38.989454Z 0 [Note] [MY-000000] [Galera] ####### Passing IST CC 5, must_apply: 0, preload: true
2021-12-07T13:06:38.989485Z 0 [Note] [MY-000000] [Galera] First IST (CC) event for rebuilding cert index
2021-12-07T13:06:38.989501Z 0 [Note] [MY-000000] [Galera] REPL Protocols: 10 (5)
2021-12-07T13:06:38.989551Z 0 [Note] [MY-000000] [Galera] Service thread queue flushed.
2021-12-07T13:06:38.989606Z 0 [Note] [MY-000000] [Galera] ####### Assign initial position for certification: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:4, protocol version: 5
2021-12-07T13:06:38.989625Z 0 [Note] [MY-000000] [Galera] REPL Protocols: 10 (5)
2021-12-07T13:06:38.989638Z 0 [Note] [MY-000000] [Galera] ####### Adjusting cert position: 4 -> 5
2021-12-07T13:06:38.989670Z 0 [Note] [MY-000000] [Galera] Service thread queue flushed.
2021-12-07T13:06:38.989711Z 0 [Note] [MY-000000] [Galera] Recording CC from preload: 5
2021-12-07T13:06:38.989726Z 0 [Note] [MY-000000] [Galera] Lowest cert index boundary for CC from preload: 5
2021-12-07T13:06:38.989738Z 0 [Note] [MY-000000] [Galera] Min available from gcache for CC from preload: 5
2021-12-07T13:06:38.989790Z 0 [Note] [MY-000000] [Galera] Receiving IST...100.0% (1/1 events) complete.
2021-12-07T13:06:38.990155Z 1 [Note] [MY-000000] [Galera] IST received: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.990476Z 1 [Note] [MY-000000] [Galera] Recording CC from sst: 5
2021-12-07T13:06:38.990507Z 1 [Note] [MY-000000] [Galera] Lowest cert index boundary for CC from sst: 5
2021-12-07T13:06:38.990523Z 1 [Note] [MY-000000] [Galera] Min available from gcache for CC from sst: 5
2021-12-07T13:06:38.990704Z 0 [Note] [MY-000000] [Galera] 1.0 (mysqldb1): State transfer from 0.0 (mysqldb2) complete.
2021-12-07T13:06:38.990731Z 0 [Note] [MY-000000] [Galera] SST leaving flow control
2021-12-07T13:06:38.990747Z 0 [Note] [MY-000000] [Galera] Shifting JOINER -> JOINED (TO: 5)
2021-12-07T13:06:38.990918Z 0 [Note] [MY-000000] [Galera] Member 1.0 (mysqldb1) synced with group.
2021-12-07T13:06:38.990934Z 0 [Note] [MY-000000] [Galera] Shifting JOINED -> SYNCED (TO: 5)
2021-12-07T13:06:38.990958Z 1 [Note] [MY-000000] [Galera] Server mysqldb1 synced with group
2021-12-07T13:06:38.990980Z 1 [Note] [MY-000000] [WSREP] Server status change joined -> synced
2021-12-07T13:06:38.990990Z 1 [Note] [MY-000000] [WSREP] Synchronized with group, ready for connections
2021-12-07T13:06:38.990999Z 1 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
可见同步新节点时760G数据,耗时45分钟。
【至此,本系列迁移、升级集群的文章连载完毕,后续真正的割接只是一个时间选择问题了】
MySQL5.7版本单节点大数据量迁移到PXC8.0版本集群全记录-3的更多相关文章
- boost的asio接收单路大数据量udp包的方法
开发windows客户端接收RTP视频流,当h264视频达到1080P 60fps的时候,按包来调用recvfrom的函数压力比较大,存在丢包的问题,windows的完成端口的性能效果当然可以解决这个 ...
- CentOS6安装各种大数据软件 第五章:Kafka集群的配置
相关文章链接 CentOS6安装各种大数据软件 第一章:各个软件版本介绍 CentOS6安装各种大数据软件 第二章:Linux各个软件启动命令 CentOS6安装各种大数据软件 第三章:Linux基础 ...
- 【大数据之数据仓库】安装部署GreenPlum集群
本篇将向大家介绍如何快捷的安装部署GreenPlum测试集群,大家可以跟着我一块儿实践一把^_^ 1.主机资源 申请2台网易云主机,操作系统必须是RedHat或者CentOS,配置尽量高一点.如果是s ...
- elasticsearch5.0集群大数据量迁移方法及注意事项
当es集群的数据量较小的情况下elasticdump这个工具比较方便,但是当数据量达到一定级别比如上百G的时候,elasticdump速度就很慢了,此时我们可以使用快照的方法进行备份 elasticd ...
- 大数据基础知识:分布式计算、服务器集群[zz]
大数据中的数据量非常巨大,达到了PB级别.而且这庞大的数据之中,不仅仅包括结构化数据(如数字.符号等数据),还包括非结构化数据(如文本.图像.声音.视频等数据).这使得大数据的存储,管理和处理很难利用 ...
- 大数据Hadoop的HA高可用架构集群部署
1 概述 在Hadoop 2.0.0之前,一个Hadoop集群只有一个NameNode,那么NameNode就会存在单点故障的问题,幸运的是Hadoop 2.0.0之后解决了这个问题,即支持N ...
- 大数据平台搭建 - cdh5.11.1 - hbase集群搭建
一.简介 HBase是一种构建在HDFS之上的分布式.面向列的存储系统.在需要实时读写.随机访问超大规模数据集时,可以使用HBase. 尽管已经有许多数据存储和访问的策略和实现方法,但事实上大多数解决 ...
- 大数据平台搭建 - cdh5.11.1 - hadoop集群安装
一.前言 由于线下测试的需要,需要在公司线下(测试)环境搭建大数据集群. 那么CDH是什么? hadoop是一个开源项目,所以很多公司再这个基础上进行商业化,不收费的hadoop版本主要有三个,分别是 ...
- 入门大数据---基于Zookeeper搭建Kafka高可用集群
一.Zookeeper集群搭建 为保证集群高可用,Zookeeper 集群的节点数最好是奇数,最少有三个节点,所以这里搭建一个三个节点的集群. 1.1 下载 & 解压 下载对应版本 Zooke ...
- 流式大数据计算实践(2)----Hadoop集群和Zookeeper
一.前言 1.上一文搭建好了Hadoop单机模式,这一文继续搭建Hadoop集群 二.搭建Hadoop集群 1.根据上文的流程得到两台单机模式的机器,并保证两台单机模式正常启动,记得第二台机器core ...
随机推荐
- Paimon读取流程
查询模式 先来看看官网关于Paimon查询模式的说明 可以看到查询模式围绕snapshot展开, 而snapshot分了两种一种是Last compact snapshot和 last snapsho ...
- 即构✖叮咚课堂:行业第一套AI课堂解决方案是怎么被实现的?
AI走进教育,是传统教育的一次迭代进化 在教育问题上,我们看到两类话题最容易引发公众讨论:教育公平和个性化教育,"互联网+教育"有可能解决第一类话题,"AI教育" ...
- Git插件报错,Appears to be a git repo or submodule
Hexo博客需要引入第三方插件,不少包作者误把包项目得.git文件上传到github,或者在插件的github路径下直接下载插件文件夹,结果是插件内含有.git文件,导致下载别的npm包时报错npm ...
- adb如何做Android ui自动化(这一篇就够了)
一.简介 我们都知道在做Android ui自动化的时候用的是appium,环境搭建贼难受.如果我们在工作中遇到需要实现简单的自动化功能,可以直接使用adb来完成,无需去搭建繁琐的appium.ADB ...
- Spring-Bean(三)
Bean生命周期配置 init-method:指定类中的初始化方法名称 destory-method:指定类中销毁方法名称 Bean标签配置 <bean id="UserDao&quo ...
- Java 调用gdal API(二)——栅格裁剪
gdal可以说是GIS数据处理比较好的工具之一,虽然也提供了Java API,但是官方文档确实太过简单,用起来确实太难受,每次都需要去参考对应的C++api,然后在对应使用. 因此小编决定从这篇文章开 ...
- 好用的windows工具分享(20个)
1.截图.画图全屏截图快捷键:printSreen窗口截图快捷键:alt+printSreen自定义截图工具:win+shift+s画图快捷键:cmd - mspaint可配合画图工具实现图片的编辑, ...
- PerfView 洞察C#托管堆内存 "黑洞现象"
一:背景 1. 讲故事 首先声明的是这个 黑洞 是我定义的术语,它是用来表示 内存吞噬 的一种现象,何为 内存吞噬,我们来看一张图. 从上面的 卦象图 来看,GCHeap 的 Allocated=85 ...
- PlayWright(二十二)- allure插件(一)
在上文中,我们介绍并使用了pytest-html插件,总之并不复杂,但是今天我们要讲一个比pytest-html插件强很多的插件allure报告,我们要掌握他并且灵活使用,之后的框架就不需要考虑其他的 ...
- Python和PyTorch深入实现线性回归模型:一篇文章全面掌握基础机器学习技术
1. 简介 1.1 线性回归模型概述 线性回归是一种统计学中的预测分析,该方法用于建立两种或两种以上变量间的关系模型.线性回归使用最佳的拟合直线(也称为回归线)在独立(输入)变量和因变量(输出)之间建 ...