MySQL5.7版本单节点大数据量迁移到PXC8.0版本集群全记录-3
接上文,单节点升级到80版本之后,构建新版本的80集群就水到渠成、相对简单了,详情可参见之前的集群构建博文。
本文在修改配置集群的新参数时,修改了pxc_strict_mode为默认的ENFORCING,注释掉skip_ssl以支持SSL加密同步传输。
donor节点的日志如下:
2021-12-07T12:21:56.351545Z 0 [Note] [MY-000000] [WSREP-SST] Streaming the backup to joiner at 10.124.206.18 4444
2021-12-07T13:06:19.710146Z 0 [Note] [MY-000000] [Galera] SST sent: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:19.710196Z 0 [Note] [MY-000000] [WSREP] Server status change donor -> joined
2021-12-07T13:06:19.710224Z 0 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:19.710565Z 0 [Note] [MY-000000] [Galera] 0.0 (mysqldb2): State transfer to 1.0 (mysqldb1) complete.
2021-12-07T13:06:19.710605Z 0 [Note] [MY-000000] [Galera] Shifting DONOR/DESYNCED -> JOINED (TO: 5)
2021-12-07T13:06:19.710815Z 0 [Note] [MY-000000] [Galera] Member 0.0 (mysqldb2) synced with group.
2021-12-07T13:06:19.710832Z 0 [Note] [MY-000000] [Galera] Shifting JOINED -> SYNCED (TO: 5)
2021-12-07T13:06:19.710890Z 10 [Note] [MY-000000] [Galera] Server mysqldb2 synced with group
2021-12-07T13:06:19.710931Z 10 [Note] [MY-000000] [WSREP] Server status change joined -> synced
2021-12-07T13:06:19.710944Z 10 [Note] [MY-000000] [WSREP] Synchronized with group, ready for connections
2021-12-07T13:06:19.710963Z 10 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.990181Z 0 [Note] [MY-000000] [Galera] async IST sender served
2021-12-07T13:06:38.990751Z 0 [Note] [MY-000000] [Galera] 1.0 (mysqldb1): State transfer from 0.0 (mysqldb2) complete.
2021-12-07T13:06:38.990963Z 0 [Note] [MY-000000] [Galera] Member 1.0 (mysqldb1) synced with group.
joiner节点的日志如下:
2021-12-07T12:21:46.624809Z 0 [Note] [MY-000000] [WSREP-SST] Proceeding with SST.........
2021-12-07T12:21:46.663620Z 0 [Note] [MY-000000] [WSREP-SST] ............Waiting for SST streaming to complete!
2021-12-07T12:21:47.528091Z 0 [Note] [MY-000000] [Galera] (3d6299de-a13c, 'ssl://0.0.0.0:4567') turning message relay requesting off
2021-12-07T13:06:19.710726Z 0 [Note] [MY-000000] [Galera] 0.0 (mysqldb2): State transfer to 1.0 (mysqldb1) complete.
2021-12-07T13:06:19.711254Z 0 [Note] [MY-000000] [Galera] Member 0.0 (mysqldb2) synced with group.
2021-12-07T13:06:19.712860Z 0 [Note] [MY-000000] [WSREP-SST] Preparing the backup at /u01/mysql/data//sst-xb-tmpdir
2021-12-07T13:06:32.139859Z 0 [Note] [MY-000000] [WSREP-SST] Moving the backup to /u01/mysql/data/
2021-12-07T13:06:32.265350Z 0 [Note] [MY-000000] [WSREP-SST] Running post-processing...........
2021-12-07T13:06:32.271818Z 0 [Note] [MY-000000] [WSREP-SST] Skipping mysql_upgrade (sst): local version (8.0.23) == donor version (8.0.23)
2021-12-07T13:06:32.363903Z 0 [Note] [MY-000000] [WSREP-SST] Waiting for server instance to start..... This may take some time
2021-12-07T13:06:37.080878Z 0 [Note] [MY-000000] [WSREP-SST] ...........post-processing done
2021-12-07T13:06:37.082170Z 0 [Note] [MY-000000] [WSREP-SST] Galera co-ords from recovery: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:37.110761Z 3 [Note] [MY-000000] [Galera] Processing SST received
2021-12-07T13:06:37.111352Z 3 [Note] [MY-000000] [WSREP] Server status change joiner -> initializing
2021-12-07T13:06:37.111828Z 3 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:37.113486Z 0 [Warning] [MY-013245] [Server] The SSL library function CRYPTO_set_mem_functions failed. This is typically caused by the SSL library already being used. As a result the SSL memory allocation will not be instrumented.
2021-12-07T13:06:37.119056Z 4 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-12-07T13:06:38.516689Z 4 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2021-12-07T13:06:38.791539Z 4 [Note] [MY-000000] [WSREP] wsrep_init_schema_and_SR (nil)
2021-12-07T13:06:38.803764Z 4 [System] [MY-000000] [WSREP] PXC upgrade completed successfully
2021-12-07T13:06:38.820853Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /var/lib/mysql/mysqlx.sock
2021-12-07T13:06:38.821518Z 0 [Warning] [MY-013129] [Server] A message intended for a client cannot be sent there as no client-session is attached. Therefore, we're sending the information to the error-log instead: MY-001287 - 'validate password plugin' is deprecated and will be removed in a future release. Please use validate_password component instead
2021-12-07T13:06:38.933070Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
2021-12-07T13:06:38.933778Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel.
2021-12-07T13:06:38.951187Z 0 [Warning] [MY-010324] [Server] 'db' entry 'percona_schema mysql.pxc.sst.role@localhost' had database in mixed case that has been forced to lowercase because lower_case_table_names is set. It will not be possible to remove this privilege using REVOKE.
2021-12-07T13:06:38.966474Z 0 [Note] [MY-000000] [WSREP] Initialized wsrep sidno 4
2021-12-07T13:06:38.967977Z 0 [Note] [MY-000000] [Galera] Server initialized
2021-12-07T13:06:38.968748Z 0 [Note] [MY-000000] [WSREP] Server status change initializing -> initialized
2021-12-07T13:06:38.969468Z 0 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.970219Z 3 [Note] [MY-000000] [WSREP] Server status change initialized -> joined
2021-12-07T13:06:38.971005Z 3 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.971772Z 3 [Note] [MY-000000] [Galera] Recovered position from storage: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.982982Z 3 [Note] [MY-000000] [Galera] Recovered view from SST:
id: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
status: primary
protocol_version: 4
capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
final: no
own_index: 1
members(2):
0: 1ad4eb4c-5757-11ec-a746-e3cb8800c1e0, mysqldb2
1: 3d6299de-5758-11ec-a13c-63e7397f116a, mysqldb1
2021-12-07T13:06:38.986279Z 3 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-12-07T13:06:38.986499Z 10 [Note] [MY-000000] [WSREP] Recovered cluster id 2865d710-5743-11ec-8f0c-7af1fec7bcb1
2021-12-07T13:06:38.986556Z 11 [Note] [MY-000000] [WSREP] Starting applier thread 11
2021-12-07T13:06:38.986584Z 12 [Note] [MY-000000] [WSREP] Starting applier thread 12
2021-12-07T13:06:38.986631Z 13 [Note] [MY-000000] [WSREP] Starting applier thread 13
2021-12-07T13:06:38.986647Z 14 [Note] [MY-000000] [WSREP] Starting applier thread 14
2021-12-07T13:06:38.986673Z 15 [Note] [MY-000000] [WSREP] Starting applier thread 15
2021-12-07T13:06:38.986727Z 17 [Note] [MY-000000] [WSREP] Starting applier thread 17
2021-12-07T13:06:38.986841Z 16 [Note] [MY-000000] [WSREP] Starting applier thread 16
2021-12-07T13:06:38.987236Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.23-14.1' socket: '/u01/mysql/mysql.sock' port: 3306 Percona XtraDB Cluster (GPL), Release rel14, Revision d3b9a1d, WSREP version 26.4.3.
2021-12-07T13:06:38.988606Z 3 [Note] [MY-000000] [Galera] SST received: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.988640Z 3 [System] [MY-000000] [WSREP] SST completed
2021-12-07T13:06:38.988688Z 1 [Note] [MY-000000] [Galera] str_proto_ver_: 3 sst_seqno_: 5 cc_seqno: 5 req->ist_len(): 67
2021-12-07T13:06:38.988741Z 1 [Note] [MY-000000] [Galera] Installed new state from SST: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.989082Z 1 [Note] [MY-000000] [Galera] Cert. index preload up to 5
2021-12-07T13:06:38.989159Z 0 [Note] [MY-000000] [Galera] ####### IST applying starts with 6
2021-12-07T13:06:38.989326Z 0 [Note] [MY-000000] [Galera] ####### IST current seqno initialized to 5
2021-12-07T13:06:38.989412Z 0 [Note] [MY-000000] [Galera] Receiving IST... 0.0% (0/1 events) complete.
2021-12-07T13:06:38.989434Z 0 [Note] [MY-000000] [Galera] IST preload starting at 5
2021-12-07T13:06:38.989454Z 0 [Note] [MY-000000] [Galera] ####### Passing IST CC 5, must_apply: 0, preload: true
2021-12-07T13:06:38.989485Z 0 [Note] [MY-000000] [Galera] First IST (CC) event for rebuilding cert index
2021-12-07T13:06:38.989501Z 0 [Note] [MY-000000] [Galera] REPL Protocols: 10 (5)
2021-12-07T13:06:38.989551Z 0 [Note] [MY-000000] [Galera] Service thread queue flushed.
2021-12-07T13:06:38.989606Z 0 [Note] [MY-000000] [Galera] ####### Assign initial position for certification: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:4, protocol version: 5
2021-12-07T13:06:38.989625Z 0 [Note] [MY-000000] [Galera] REPL Protocols: 10 (5)
2021-12-07T13:06:38.989638Z 0 [Note] [MY-000000] [Galera] ####### Adjusting cert position: 4 -> 5
2021-12-07T13:06:38.989670Z 0 [Note] [MY-000000] [Galera] Service thread queue flushed.
2021-12-07T13:06:38.989711Z 0 [Note] [MY-000000] [Galera] Recording CC from preload: 5
2021-12-07T13:06:38.989726Z 0 [Note] [MY-000000] [Galera] Lowest cert index boundary for CC from preload: 5
2021-12-07T13:06:38.989738Z 0 [Note] [MY-000000] [Galera] Min available from gcache for CC from preload: 5
2021-12-07T13:06:38.989790Z 0 [Note] [MY-000000] [Galera] Receiving IST...100.0% (1/1 events) complete.
2021-12-07T13:06:38.990155Z 1 [Note] [MY-000000] [Galera] IST received: 2865d710-5743-11ec-8f0c-7af1fec7bcb1:5
2021-12-07T13:06:38.990476Z 1 [Note] [MY-000000] [Galera] Recording CC from sst: 5
2021-12-07T13:06:38.990507Z 1 [Note] [MY-000000] [Galera] Lowest cert index boundary for CC from sst: 5
2021-12-07T13:06:38.990523Z 1 [Note] [MY-000000] [Galera] Min available from gcache for CC from sst: 5
2021-12-07T13:06:38.990704Z 0 [Note] [MY-000000] [Galera] 1.0 (mysqldb1): State transfer from 0.0 (mysqldb2) complete.
2021-12-07T13:06:38.990731Z 0 [Note] [MY-000000] [Galera] SST leaving flow control
2021-12-07T13:06:38.990747Z 0 [Note] [MY-000000] [Galera] Shifting JOINER -> JOINED (TO: 5)
2021-12-07T13:06:38.990918Z 0 [Note] [MY-000000] [Galera] Member 1.0 (mysqldb1) synced with group.
2021-12-07T13:06:38.990934Z 0 [Note] [MY-000000] [Galera] Shifting JOINED -> SYNCED (TO: 5)
2021-12-07T13:06:38.990958Z 1 [Note] [MY-000000] [Galera] Server mysqldb1 synced with group
2021-12-07T13:06:38.990980Z 1 [Note] [MY-000000] [WSREP] Server status change joined -> synced
2021-12-07T13:06:38.990990Z 1 [Note] [MY-000000] [WSREP] Synchronized with group, ready for connections
2021-12-07T13:06:38.990999Z 1 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
可见同步新节点时760G数据,耗时45分钟。
【至此,本系列迁移、升级集群的文章连载完毕,后续真正的割接只是一个时间选择问题了】
MySQL5.7版本单节点大数据量迁移到PXC8.0版本集群全记录-3的更多相关文章
- boost的asio接收单路大数据量udp包的方法
开发windows客户端接收RTP视频流,当h264视频达到1080P 60fps的时候,按包来调用recvfrom的函数压力比较大,存在丢包的问题,windows的完成端口的性能效果当然可以解决这个 ...
- CentOS6安装各种大数据软件 第五章:Kafka集群的配置
相关文章链接 CentOS6安装各种大数据软件 第一章:各个软件版本介绍 CentOS6安装各种大数据软件 第二章:Linux各个软件启动命令 CentOS6安装各种大数据软件 第三章:Linux基础 ...
- 【大数据之数据仓库】安装部署GreenPlum集群
本篇将向大家介绍如何快捷的安装部署GreenPlum测试集群,大家可以跟着我一块儿实践一把^_^ 1.主机资源 申请2台网易云主机,操作系统必须是RedHat或者CentOS,配置尽量高一点.如果是s ...
- elasticsearch5.0集群大数据量迁移方法及注意事项
当es集群的数据量较小的情况下elasticdump这个工具比较方便,但是当数据量达到一定级别比如上百G的时候,elasticdump速度就很慢了,此时我们可以使用快照的方法进行备份 elasticd ...
- 大数据基础知识:分布式计算、服务器集群[zz]
大数据中的数据量非常巨大,达到了PB级别.而且这庞大的数据之中,不仅仅包括结构化数据(如数字.符号等数据),还包括非结构化数据(如文本.图像.声音.视频等数据).这使得大数据的存储,管理和处理很难利用 ...
- 大数据Hadoop的HA高可用架构集群部署
1 概述 在Hadoop 2.0.0之前,一个Hadoop集群只有一个NameNode,那么NameNode就会存在单点故障的问题,幸运的是Hadoop 2.0.0之后解决了这个问题,即支持N ...
- 大数据平台搭建 - cdh5.11.1 - hbase集群搭建
一.简介 HBase是一种构建在HDFS之上的分布式.面向列的存储系统.在需要实时读写.随机访问超大规模数据集时,可以使用HBase. 尽管已经有许多数据存储和访问的策略和实现方法,但事实上大多数解决 ...
- 大数据平台搭建 - cdh5.11.1 - hadoop集群安装
一.前言 由于线下测试的需要,需要在公司线下(测试)环境搭建大数据集群. 那么CDH是什么? hadoop是一个开源项目,所以很多公司再这个基础上进行商业化,不收费的hadoop版本主要有三个,分别是 ...
- 入门大数据---基于Zookeeper搭建Kafka高可用集群
一.Zookeeper集群搭建 为保证集群高可用,Zookeeper 集群的节点数最好是奇数,最少有三个节点,所以这里搭建一个三个节点的集群. 1.1 下载 & 解压 下载对应版本 Zooke ...
- 流式大数据计算实践(2)----Hadoop集群和Zookeeper
一.前言 1.上一文搭建好了Hadoop单机模式,这一文继续搭建Hadoop集群 二.搭建Hadoop集群 1.根据上文的流程得到两台单机模式的机器,并保证两台单机模式正常启动,记得第二台机器core ...
随机推荐
- 6大数据实战系列-sparkSql实战
sparkSql两个最重要的类SqlContext.DataFrame,DataFrame功能强大,能够与rdd互转换.支持sql操作如sql().where.order.join.groupBy.l ...
- C++面试八股文:什么是构造函数?
某日二师兄参加XXX科技公司的C++工程师开发岗位第29面: 面试官:什么是构造函数? 二师兄:构造函数是一种特殊的成员函数,用于创建和初始化类的对象.构造函数的名称与类的名称相同,并且没有返回类型. ...
- Android BottomNavigation底部导航栏使用
原文地址: Android BottomNavigation底部导航栏使用 - Stars-One的杂货小窝 基本使用 本文侧重点记录一些特殊的样式设置,所以基本使用这里就简单概述一下,详细图文可以去 ...
- 浅谈REFS文件系统数据恢复研发经历(1)
作为80后技术员, 我一直很喜欢李玟, 是我们那个时代的偶像, 一直也很喜欢听他的歌, 看到她的噩耗, 还是很那么的无法理解, 一个那么好的人怎么会得抑郁症呢, 心里多少还是无法接受. 不过联想到自己 ...
- JS中使用Promise.all控制所有的异步请求都完成后,在执行后续逻辑
使用场景为,在js中连续的几个异步耗时操作,后面的耗时操作需要使用第一个操作的返回结果.例如调用ajax异步接口,需要先创建完主表,然后拿到主表id在去循环创建明细表,等全部创建完成后,弹出提示来,或 ...
- 一文学会TextureID渲染到Surface
最近遇到一个需求,要求将一个GL_TEXTURE_2D类型的纹理ID写入到ImageReader生成的Surface中. 其实这个需求与我之前写过的一篇文章 一文学会MediaCodeC与OpenGL ...
- 2023-07-19:布尔表达式 是计算结果不是 true 就是 false 的表达式 有效的表达式需遵循以下约定: ‘t‘,运算结果为 true ‘f‘,运算结果为 false ‘!(subExpr
2023-07-19:布尔表达式 是计算结果不是 true 就是 false 的表达式 有效的表达式需遵循以下约定: 't',运算结果为 true 'f',运算结果为 false '!(subExpr ...
- quarkus实战之八:profile
欢迎访问我的GitHub 这里分类和汇总了欣宸的全部原创(含配套源码):https://github.com/zq2599/blog_demos 本篇概览 本文是<quarkus实战>系列 ...
- GitLab 无仓库 中了勒索病毒
坑爹的记录一下,并没有解决 Gitlab 昨天(2021-11-29)打开之后看不到项目了,下面这个吊样子 最后发现中病毒了,一堆的这个吊毛文件,复制一个打开看了一下 你别说这个黑客网页写的还不错,这 ...
- 利用文件包含漏洞包含ssh日志拿shell
今天看文章学了一招,有包含漏洞无法传文件的时候用 目标服务器环境为ubuntu,ssh登录日志文件是/var/log/auth.log 找个Linux的环境执行ssh '<? phpinfo() ...