debezium之mysql配置

实验环境

全部部署于本地虚拟机

1 mysql

参考 官方文档 和 根据官方示例镜像（debezium/example-mysql，mysql版本为8.0.32）

1.1 创建用户

官方镜像里一共有三个账号

debezium：connect用户

mysqluser：普通用户

replicator：用于主从？

设置命令

create user 'debezium'@'%' identified by "dbz";
create user 'mysqluser'@'%' identified by "mysqlpw";
create user 'replicator'@'%' identified by "replicator";
GRANT SELECT, RELOAD, SHOW DATABASES, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'debezium'@'%';
GRANT USAGE ON *.* TO 'mysqluser'@'%';
GRANT ALL PRIVILEGES ON `inventory`.* TO 'mysqluser'@'%';
GRANT REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'replicator'@'%';
flush privileges;

查询命令

select host,user from mysql.user;
show grants for `debezium`@`%`;

1.2 设置binlog

镜像配置文件

/etc/mysql/conf.d/mysql.cnf

[mysqld]
skip-host-cache
skip-name-resolve
user=mysql
symbolic-links=0
# ----------------------------------------------
# Enable the binlog for replication & CDC
# ----------------------------------------------
# Enable binary replication log and set the prefix, expiration, and log format.
# The prefix is arbitrary, expiration can be short for integration tests but would
# be longer on a production system. Row-level info is required for ingest to work.
# Server ID is required, but this will vary on production systems
server-id = 223344
log_bin = mysql-bin
expire_logs_days = 1
binlog_format = row

default_authentication_plugin = mysql_native_password

查询命令

SELECT variable_value as "BINARY LOGGING STATUS (log-bin) ::" FROM performance_schema.global_variables WHERE variable_name='log_bin';

1.3 使能GTIDs（实际镜像中未开启）

查询命令

SHOW VARIABLES LIKE 'gtid_mode';

1.4 配置会话定时器（实际镜像中为默认值 28800）

查询命令

show variables like 'interactive_timeout';
show variables like 'wait_timeout';

1.5 Enabling query log events（实际镜像中未开启）

查询命令

show variables like 'binlog_rows_query_log_events';

1.6 确认binlog row value options

查询命令

确保不为“PARTIAL_JSON”即可

show global variables where variable_name = 'binlog_row_value_options';

配置命令

set @@global.binlog_row_value_options="" ;

2 启动kafka（未完成）

参考博文

单节点kafka部署笔记

3 启动connector（未完成）

下载docker镜像

docker pull quay.io/debezium/postgres