MySQL5.7版本单节点大数据量迁移到PXC8.0版本集群全记录-3
接上文，单节点升级到80版本之后，构建新版本的80集群就水到渠成、相对简单了，详情可参见之前的集群构建博文。
本文在修改配置集群的新参数时，修改了pxc_strict_mode为默认的ENFORCING，注释掉skip_ssl以支持SSL加密同步传输。
donor节点的日志如下：
2021-12-07T12:21:56.351545Z 0 [Note] [MY-000000] [WSREP-SST] Streaming the backup to joiner at 10.124.206.18 4444
2021-12-07T13:06:19.710146Z 0 [Note] [MY-000000] [Galera] SST sent: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:19.710196Z 0 [Note] [MY-000000] [WSREP] Server status change donor -> joined
2021-12-07T13:06:19.710224Z 0 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:19.710565Z 0 [Note] [MY-000000] [Galera] 0.0 (mysqldb2): State transfer to 1.0 (mysqldb1) complete.
2021-12-07T13:06:19.710605Z 0 [Note] [MY-000000] [Galera] Shifting DONOR/DESYNCED -> JOINED (TO: 5)
2021-12-07T13:06:19.710815Z 0 [Note] [MY-000000] [Galera] Member 0.0 (mysqldb2) synced with group.
2021-12-07T13:06:19.710832Z 0 [Note] [MY-000000] [Galera] Shifting JOINED -> SYNCED (TO: 5)
2021-12-07T13:06:19.710890Z 10 [Note] [MY-000000] [Galera] Server mysqldb2 synced with group
2021-12-07T13:06:19.710931Z 10 [Note] [MY-000000] [WSREP] Server status change joined -> synced
2021-12-07T13:06:19.710944Z 10 [Note] [MY-000000] [WSREP] Synchronized with group, ready for connections
2021-12-07T13:06:19.710963Z 10 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.990181Z 0 [Note] [MY-000000] [Galera] async IST sender served
2021-12-07T13:06:38.990751Z 0 [Note] [MY-000000] [Galera] 1.0 (mysqldb1): State transfer from 0.0 (mysqldb2) complete.
2021-12-07T13:06:38.990963Z 0 [Note] [MY-000000] [Galera] Member 1.0 (mysqldb1) synced with group.
joiner节点的日志如下：
2021-12-07T12:21:46.624809Z 0 [Note] [MY-000000] [WSREP-SST] Proceeding with SST.........
2021-12-07T12:21:46.663620Z 0 [Note] [MY-000000] [WSREP-SST] ............Waiting for SST streaming to complete!
2021-12-07T12:21:47.528091Z 0 [Note] [MY-000000] [Galera] (3d6299de-a13c, 'ssl://0.0.0.0:4567') turning message relay requesting off
2021-12-07T13:06:19.710726Z 0 [Note] [MY-000000] [Galera] 0.0 (mysqldb2): State transfer to 1.0 (mysqldb1) complete.
2021-12-07T13:06:19.711254Z 0 [Note] [MY-000000] [Galera] Member 0.0 (mysqldb2) synced with group.
2021-12-07T13:06:19.712860Z 0 [Note] [MY-000000] [WSREP-SST] Preparing the backup at /u01/mysql/data//sst-xb-tmpdir
2021-12-07T13:06:32.139859Z 0 [Note] [MY-000000] [WSREP-SST] Moving the backup to /u01/mysql/data/
2021-12-07T13:06:32.265350Z 0 [Note] [MY-000000] [WSREP-SST] Running post-processing...........
2021-12-07T13:06:32.271818Z 0 [Note] [MY-000000] [WSREP-SST] Skipping mysql_upgrade (sst): local version (8.0.23) == donor version (8.0.23)
2021-12-07T13:06:32.363903Z 0 [Note] [MY-000000] [WSREP-SST] Waiting for server instance to start..... This may take some time
2021-12-07T13:06:37.080878Z 0 [Note] [MY-000000] [WSREP-SST] ...........post-processing done
2021-12-07T13:06:37.082170Z 0 [Note] [MY-000000] [WSREP-SST] Galera co-ords from recovery: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:37.110761Z 3 [Note] [MY-000000] [Galera] Processing SST received
2021-12-07T13:06:37.111352Z 3 [Note] [MY-000000] [WSREP] Server status change joiner -> initializing
2021-12-07T13:06:37.111828Z 3 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:37.113486Z 0 [Warning] [MY-013245] [Server] The SSL library function CRYPTO_set_mem_functions failed. This is typically caused by the SSL library already being used. As a result the SSL memory allocation will not be instrumented.
2021-12-07T13:06:37.119056Z 4 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-12-07T13:06:38.516689Z 4 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2021-12-07T13:06:38.791539Z 4 [Note] [MY-000000] [WSREP] wsrep_init_schema_and_SR (nil)
2021-12-07T13:06:38.803764Z 4 [System] [MY-000000] [WSREP] PXC upgrade completed successfully
2021-12-07T13:06:38.820853Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /var/lib/mysql/mysqlx.sock
2021-12-07T13:06:38.821518Z 0 [Warning] [MY-013129] [Server] A message intended for a client cannot be sent there as no client-session is attached. Therefore, we're sending the information to the error-log instead: MY-001287 - 'validate password plugin' is deprecated and will be removed in a future release. Please use validate_password component instead
2021-12-07T13:06:38.933070Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
2021-12-07T13:06:38.933778Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel.
2021-12-07T13:06:38.951187Z 0 [Warning] [MY-010324] [Server] 'db' entry 'percona_schema mysql.pxc.sst.role@localhost' had database in mixed case that has been forced to lowercase because lower_case_table_names is set. It will not be possible to remove this privilege using REVOKE.
2021-12-07T13:06:38.966474Z 0 [Note] [MY-000000] [WSREP] Initialized wsrep sidno 4
2021-12-07T13:06:38.967977Z 0 [Note] [MY-000000] [Galera] Server initialized
2021-12-07T13:06:38.968748Z 0 [Note] [MY-000000] [WSREP] Server status change initializing -> initialized
2021-12-07T13:06:38.969468Z 0 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.970219Z 3 [Note] [MY-000000] [WSREP] Server status change initialized -> joined
2021-12-07T13:06:38.971005Z 3 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.971772Z 3 [Note] [MY-000000] [Galera] Recovered position from storage: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.982982Z 3 [Note] [MY-000000] [Galera] Recovered view from SST:
id: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
status: primary
protocol_version: 4
capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
final: no
own_index: 1
members(2):
0: 1ad4eb4c-5757-11ec-a746-e3cb8800c1e0, mysqldb2
1: 3d6299de-5758-11ec-a13c-63e7397f116a, mysqldb1
2021-12-07T13:06:38.986279Z 3 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.986499Z 10 [Note] [MY-000000] [WSREP] Recovered cluster id 2865d710-5743-11ec-8f0c-7af1fec7bcb1
2021-12-07T13:06:38.986556Z 11 [Note] [MY-000000] [WSREP] Starting applier thread 11
2021-12-07T13:06:38.986584Z 12 [Note] [MY-000000] [WSREP] Starting applier thread 12
2021-12-07T13:06:38.986631Z 13 [Note] [MY-000000] [WSREP] Starting applier thread 13
2021-12-07T13:06:38.986647Z 14 [Note] [MY-000000] [WSREP] Starting applier thread 14
2021-12-07T13:06:38.986673Z 15 [Note] [MY-000000] [WSREP] Starting applier thread 15
2021-12-07T13:06:38.986727Z 17 [Note] [MY-000000] [WSREP] Starting applier thread 17
2021-12-07T13:06:38.986841Z 16 [Note] [MY-000000] [WSREP] Starting applier thread 16
2021-12-07T13:06:38.987236Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.23-14.1' socket: '/u01/mysql/mysql.sock' port: 3306 Percona XtraDB Cluster (GPL), Release rel14, Revision d3b9a1d, WSREP version 26.4.3.
2021-12-07T13:06:38.988606Z 3 [Note] [MY-000000] [Galera] SST received: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.988640Z 3 [System] [MY-000000] [WSREP] SST completed
2021-12-07T13:06:38.988688Z 1 [Note] [MY-000000] [Galera] str_proto_ver_: 3 sst_seqno_: 5 cc_seqno: 5 req->ist_len(): 67
2021-12-07T13:06:38.988741Z 1 [Note] [MY-000000] [Galera] Installed new state from SST: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.989082Z 1 [Note] [MY-000000] [Galera] Cert. index preload up to 5
2021-12-07T13:06:38.989159Z 0 [Note] [MY-000000] [Galera] ####### IST applying starts with 6
2021-12-07T13:06:38.989326Z 0 [Note] [MY-000000] [Galera] ####### IST current seqno initialized to 5
2021-12-07T13:06:38.989412Z 0 [Note] [MY-000000] [Galera] Receiving IST... 0.0% (0/1 events) complete.
2021-12-07T13:06:38.989434Z 0 [Note] [MY-000000] [Galera] IST preload starting at 5
2021-12-07T13:06:38.989454Z 0 [Note] [MY-000000] [Galera] ####### Passing IST CC 5, must_apply: 0, preload: true
2021-12-07T13:06:38.989485Z 0 [Note] [MY-000000] [Galera] First IST (CC) event for rebuilding cert index
2021-12-07T13:06:38.989501Z 0 [Note] [MY-000000] [Galera] REPL Protocols: 10 (5)
2021-12-07T13:06:38.989551Z 0 [Note] [MY-000000] [Galera] Service thread queue flushed.
2021-12-07T13:06:38.989606Z 0 [Note] [MY-000000] [Galera] ####### Assign initial position for certification: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:4, protocol version: 5
2021-12-07T13:06:38.989625Z 0 [Note] [MY-000000] [Galera] REPL Protocols: 10 (5)
2021-12-07T13:06:38.989638Z 0 [Note] [MY-000000] [Galera] ####### Adjusting cert position: 4 -> 5
2021-12-07T13:06:38.989670Z 0 [Note] [MY-000000] [Galera] Service thread queue flushed.
2021-12-07T13:06:38.989711Z 0 [Note] [MY-000000] [Galera] Recording CC from preload: 5
2021-12-07T13:06:38.989726Z 0 [Note] [MY-000000] [Galera] Lowest cert index boundary for CC from preload: 5
2021-12-07T13:06:38.989738Z 0 [Note] [MY-000000] [Galera] Min available from gcache for CC from preload: 5
2021-12-07T13:06:38.989790Z 0 [Note] [MY-000000] [Galera] Receiving IST...100.0% (1/1 events) complete.
2021-12-07T13:06:38.990155Z 1 [Note] [MY-000000] [Galera] IST received: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.990476Z 1 [Note] [MY-000000] [Galera] Recording CC from sst: 5
2021-12-07T13:06:38.990507Z 1 [Note] [MY-000000] [Galera] Lowest cert index boundary for CC from sst: 5
2021-12-07T13:06:38.990523Z 1 [Note] [MY-000000] [Galera] Min available from gcache for CC from sst: 5
2021-12-07T13:06:38.990704Z 0 [Note] [MY-000000] [Galera] 1.0 (mysqldb1): State transfer from 0.0 (mysqldb2) complete.
2021-12-07T13:06:38.990731Z 0 [Note] [MY-000000] [Galera] SST leaving flow control
2021-12-07T13:06:38.990747Z 0 [Note] [MY-000000] [Galera] Shifting JOINER -> JOINED (TO: 5)
2021-12-07T13:06:38.990918Z 0 [Note] [MY-000000] [Galera] Member 1.0 (mysqldb1) synced with group.
2021-12-07T13:06:38.990934Z 0 [Note] [MY-000000] [Galera] Shifting JOINED -> SYNCED (TO: 5)
2021-12-07T13:06:38.990958Z 1 [Note] [MY-000000] [Galera] Server mysqldb1 synced with group
2021-12-07T13:06:38.990980Z 1 [Note] [MY-000000] [WSREP] Server status change joined -> synced
2021-12-07T13:06:38.990990Z 1 [Note] [MY-000000] [WSREP] Synchronized with group, ready for connections
2021-12-07T13:06:38.990999Z 1 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
可见同步新节点时760G数据，耗时45分钟。
【至此，本系列迁移、升级集群的文章连载完毕，后续真正的割接只是一个时间选择问题了】
MySQL5.7版本单节点大数据量迁移到PXC8.0版本集群全记录-3的更多相关文章
- boost的asio接收单路大数据量udp包的方法
开发windows客户端接收RTP视频流,当h264视频达到1080P 60fps的时候,按包来调用recvfrom的函数压力比较大,存在丢包的问题,windows的完成端口的性能效果当然可以解决这个 ...
- CentOS6安装各种大数据软件 第五章：Kafka集群的配置
相关文章链接 CentOS6安装各种大数据软件 第一章:各个软件版本介绍 CentOS6安装各种大数据软件 第二章:Linux各个软件启动命令 CentOS6安装各种大数据软件 第三章:Linux基础 ...
- 【大数据之数据仓库】安装部署GreenPlum集群
本篇将向大家介绍如何快捷的安装部署GreenPlum测试集群,大家可以跟着我一块儿实践一把^_^ 1.主机资源 申请2台网易云主机,操作系统必须是RedHat或者CentOS,配置尽量高一点.如果是s ...
- elasticsearch5.0集群大数据量迁移方法及注意事项
当es集群的数据量较小的情况下elasticdump这个工具比较方便,但是当数据量达到一定级别比如上百G的时候,elasticdump速度就很慢了,此时我们可以使用快照的方法进行备份 elasticd ...
- 大数据基础知识：分布式计算、服务器集群[zz]
大数据中的数据量非常巨大,达到了PB级别.而且这庞大的数据之中,不仅仅包括结构化数据(如数字.符号等数据),还包括非结构化数据(如文本.图像.声音.视频等数据).这使得大数据的存储,管理和处理很难利用 ...
- 大数据Hadoop的HA高可用架构集群部署
1 概述 在Hadoop 2.0.0之前,一个Hadoop集群只有一个NameNode,那么NameNode就会存在单点故障的问题,幸运的是Hadoop 2.0.0之后解决了这个问题,即支持N ...
- 大数据平台搭建 - cdh5.11.1 - hbase集群搭建
一.简介 HBase是一种构建在HDFS之上的分布式.面向列的存储系统.在需要实时读写.随机访问超大规模数据集时,可以使用HBase. 尽管已经有许多数据存储和访问的策略和实现方法,但事实上大多数解决 ...
- 大数据平台搭建 - cdh5.11.1 - hadoop集群安装
一.前言 由于线下测试的需要,需要在公司线下(测试)环境搭建大数据集群. 那么CDH是什么? hadoop是一个开源项目,所以很多公司再这个基础上进行商业化,不收费的hadoop版本主要有三个,分别是 ...
- 入门大数据---基于Zookeeper搭建Kafka高可用集群
一.Zookeeper集群搭建 为保证集群高可用,Zookeeper 集群的节点数最好是奇数,最少有三个节点,所以这里搭建一个三个节点的集群. 1.1 下载 & 解压 下载对应版本 Zooke ...
- 流式大数据计算实践（2）----Hadoop集群和Zookeeper
一.前言 1.上一文搭建好了Hadoop单机模式,这一文继续搭建Hadoop集群 二.搭建Hadoop集群 1.根据上文的流程得到两台单机模式的机器,并保证两台单机模式正常启动,记得第二台机器core ...
随机推荐
- Burp+Xray的联动使用
Burp+Xray的联动使用 步骤如下, 1)首先,我们启动Xray的url监听功能,我们设置监听地址为127.0.0.1,端口为7777.监听的报告输出到xray文件夹根目录下的proxy_test ...
- 什么是 CSR、SSR、SSG、ISR - 渲染模式详解
本文以 React.Vue 为例,介绍下主流的渲染模式以及在主流框架中如何实现上述的渲染模式. 前置知识介绍 看渲染模式之前我们先看下几个主流框架所提供的相关能力,了解的可跳到下个章节. 挂载组件到 ...
- Lord Of The Root: 1.0.1实战
前言 Description:我创建这台机器是为了帮助其他人学习一些基本的CTF黑客策略和一些工具.我瞄准了这台机器,使其在难度上与我在OSCP上破解的机器非常相似. 这是一个引导到根计算机将不需要任 ...
- Word书签替换，加盖电子印章及转换PDF（Java实用版）
一.前言 在项目中有需要对word进行操作的,可以看看哈,本次使用比较强大的spire组件来对word进行操作,免费版支持三页哦,对于不止三页的word文件,可以购买收费版,官网:https://ww ...
- salesforce零基础学习（一百二十九）Lead Convertion 有趣的经历
本篇参考:https://help.salesforce.com/s/articleView?id=000382564&type=1 Lead Convertion 是salesforce中s ...
- wireshark 怎么过滤字符串 和 复制data中的可读文本
设置 首先点击,[捕获]下面的小放大镜 选择 分组字节流 - 窄(UTF-8/ASCII)- 字符串 (注意,要向选择字符串) 效果 复制报文中的可读数据 右键报文,复制,...as Printabl ...
- Linux 问题：网络相关
防火墙 同网段双网卡 双网关 看服务日志
- c#如何使用WASM跨语言调用？
介绍Wasm(WebAssembly) WebAssembly(简称Wasm)是一种用于基于堆栈的虚拟机的二进制指令格式.Wasm被设计为编程语言的可移植编译目标,支持在web上部署客户端和服务器应用 ...
- 2023-08-10：景区里有m个项目，也就是项目数组为int[][] game，这是一个m*2的二维数组 景区的第i个项目有如下两个参数： game[i] = { Ki, Bi } Ki一定是负数，
2023-08-10:景区里有m个项目,也就是项目数组为int[][] game,这是一个m*2的二维数组 景区的第i个项目有如下两个参数: game[i] = { Ki, Bi } Ki一定是负数, ...
- Redis系列20：LFU内存淘汰算法分析
Redis系列1:深刻理解高性能Redis的本质 Redis系列2:数据持久化提高可用性 Redis系列3:高可用之主从架构 Redis系列4:高可用之Sentinel(哨兵模式) Redis系列5: ...