canal突然重连polardb,但后面没有将数据发到kafka上 #5538
Description
- I have searched the issues of this repository and believe that this is not a duplicate.
- I have checked the FAQ of this repository and believe that this is not a duplicate.
environment
- canal version:1.1.6
- mysql version:polardb 5.7
Issue Description
canal突然重连polardb,重连成功后,后面没有将数据发到kafka上,日志如下:
2025-11-03 19:59:49.685 [canalx-message-48] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：8，消息列表：1
2025-11-03 19:59:49.686 [canalx-message-18] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：4，消息列表：4
2025-11-03 19:59:49.685 [canalx-message-39] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：1，消息列表：4
2025-11-03 19:59:49.685 [canalx-message-12] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：7，消息列表：2
2025-11-03 19:59:49.685 [canalx-message-9] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：6，消息列表：2
2025-11-03 19:59:49.685 [canalx-message-2] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：6，消息列表：2
2025-11-03 19:59:49.685 [canalx-message-11] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：8，消息列表：1
2025-11-03 19:59:49.686 [canalx-message-48] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：6，消息列表：1
2025-11-03 19:59:49.686 [canalx-message-18] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：5，消息列表：1
2025-11-03 19:59:49.686 [canalx-message-48] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：1，消息列表：4
2025-11-03 19:59:49.686 [canalx-message-18] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：0，消息列表：9
2025-11-03 19:59:49.686 [canalx-message-12] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：5，消息列表：4
2025-11-03 19:59:49.686 [canalx-message-2] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：3，消息列表：6
2025-11-03 19:59:49.686 [canalx-message-11] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：2，消息列表：4
2025-11-03 19:59:49.686 [canalx-message-9] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：4，消息列表：10
2025-11-03 19:59:49.686 [canalx-message-48] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：6，消息列表：7
2025-11-03 19:59:49.686 [canalx-message-39] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：7，消息列表：5
2025-11-03 19:59:49.686 [canalx-message-40] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：8，消息列表：3
2025-11-03 19:59:49.686 [canalx-message-47] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：9，消息列表：1
2025-11-03 19:59:49.686 [pool-5-thread-4] INFO com.alibaba.otter.canal.connector.core.util.StopWatch - batchId:149084874 发送到kafka总耗时:1 ms
2025-11-03 19:59:49.735 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] ERROR c.a.o.canal.parse.inbound.mysql.dbsync.DirectLogFetcher - I/O error while reading from client socket
java.io.IOException: EOF encountered.
at com.alibaba.otter.canal.parse.driver.mysql.socket.BioSocketChannel.read(BioSocketChannel.java:113) ~[canalx.parse.driver-1.1.5.jar:na]
at com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch0(DirectLogFetcher.java:170) ~[canalx.parse-1.1.5.jar:na]
at com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch(DirectLogFetcher.java:77) ~[canalx.parse-1.1.5.jar:na]
at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.dump(MysqlConnection.java:238) [canalx.parse-1.1.5.jar:na]
at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$1.run(AbstractEventParser.java:263) [canalx.parse-1.1.5.jar:na]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_221]
2025-11-03 19:59:49.739 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] ERROR c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - dump address pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 has an error, retrying. caused by
java.io.IOException: EOF encountered.
at com.alibaba.otter.canal.parse.driver.mysql.socket.BioSocketChannel.read(BioSocketChannel.java:113) ~[canalx.parse.driver-1.1.5.jar:na]
at com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch0(DirectLogFetcher.java:170) ~[canalx.parse-1.1.5.jar:na]
at com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch(DirectLogFetcher.java:77) ~[canalx.parse-1.1.5.jar:na]
at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.dump(MysqlConnection.java:238) ~[canalx.parse-1.1.5.jar:na]
at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$1.run(AbstractEventParser.java:263) ~[canalx.parse-1.1.5.jar:na]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_221]
2025-11-03 19:59:49.740 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] ERROR com.alibaba.otter.canal.common.alarm.LogAlarmHandler - destination:dimfeaturedb_afi_feature[java.io.IOException: EOF encountered.
at com.alibaba.otter.canal.parse.driver.mysql.socket.BioSocketChannel.read(BioSocketChannel.java:113)
at com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch0(DirectLogFetcher.java:170)
at com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch(DirectLogFetcher.java:77)
at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.dump(MysqlConnection.java:238)
at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$1.run(AbstractEventParser.java:263)
at java.lang.Thread.run(Thread.java:748)
]
2025-11-03 19:59:49.743 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - disConnect MysqlConnection to pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306...
2025-11-03 19:59:49.743 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - disConnect MysqlConnection to pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306...
2025-11-03 19:59:49.754 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - connect MysqlConnection to pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306...
2025-11-03 19:59:49.754 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - handshake initialization packet received, prepare the client authentication packet to send
2025-11-03 19:59:49.754 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - client authentication packet is sent out.
2025-11-03 19:59:49.757 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - KILL DUMP 367436670 failure
java.io.IOException: ErrorPacket [errorNumber=1094, fieldCount=-1, message=Unknown thread id: 367436670, sqlState=HY000, sqlStateMarker=#]
with command: KILL CONNECTION 367436670
at com.alibaba.otter.canal.parse.driver.mysql.MysqlUpdateExecutor.update(MysqlUpdateExecutor.java:49) ~[canalx.parse.driver-1.1.5.jar:na]
at com.alibaba.otter.canal.parse.driver.mysql.MysqlConnector.disconnect(MysqlConnector.java:115) ~[canalx.parse.driver-1.1.5.jar:na]
at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.disconnect(MysqlConnection.java:98) [canalx.parse-1.1.5.jar:na]
at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$1.run(AbstractEventParser.java:313) [canalx.parse-1.1.5.jar:na]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_221]
2025-11-03 19:59:49.757 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - disConnect MysqlConnection to pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306...
2025-11-03 19:59:49.792 [pool-5-thread-4] INFO c.a.otter.canal.server.embedded.CanalServerWithEmbedded - getWithoutAck successfully, clientId:1001 batchSize:8000 real size is 9 and result is [batchId:149084875 , position:PositionRange[start=LogPosition[identity=LogIdentity[sourceAddress=pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306,slaveId=-1],postion=EntryPosition[included=false,journalName=mysql-bin.149522,position=500942355,serverId=100336765,gtid=,timestamp=1762199989000]],ack=,end=LogPosition[identity=LogIdentity[sourceAddress=pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306,slaveId=-1],postion=EntryPosition[included=false,journalName=mysql-bin.149522,position=501012333,serverId=100336765,gtid=,timestamp=1762199989000]],endSeq=34497139506]]
2025-11-03 19:59:49.792 [canalx-send-295652] INFO c.a.otter.canal.connector.core.producer.MQMessageUtils - 并行构建的binlog event花费时间：0 ms,并行构建线程数: 20
2025-11-03 19:59:49.792 [canalx-send-295592] INFO c.a.otter.canal.connector.core.producer.MQMessageUtils - 并行构建的binlog event花费时间：0 ms,并行构建线程数: 20
2025-11-03 19:59:49.792 [canalx-send-295601] INFO c.a.otter.canal.connector.core.producer.MQMessageUtils - 并行构建的binlog event花费时间：0 ms,并行构建线程数: 20
2025-11-03 19:59:49.792 [canalx-send-295674] INFO c.a.otter.canal.connector.core.producer.MQMessageUtils - 并行构建的binlog event花费时间：0 ms,并行构建线程数: 20
2025-11-03 19:59:49.792 [canalx-send-295536] INFO c.a.otter.canal.connector.core.producer.MQMessageUtils - 并行构建的binlog event花费时间：0 ms,并行构建线程数: 20
2025-11-03 19:59:49.792 [canalx-message-48] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：7，消息列表：1
2025-11-03 19:59:49.792 [canalx-message-39] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：0，消息列表：2
2025-11-03 19:59:49.793 [canalx-message-39] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：0，消息列表：1
2025-11-03 19:59:49.793 [canalx-send-295672] INFO c.a.otter.canal.connector.core.producer.MQMessageUtils - 并行构建的binlog event花费时间：1 ms,并行构建线程数: 20
2025-11-03 19:59:49.793 [canalx-message-39] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：2，消息列表：2
2025-11-03 19:59:49.792 [canalx-message-48] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：8，消息列表：1
2025-11-03 19:59:49.793 [canalx-send-295581] INFO c.a.otter.canal.connector.core.producer.MQMessageUtils - 并行构建的binlog event花费时间：0 ms,并行构建线程数: 20
2025-11-03 19:59:49.793 [canalx-message-48] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：6，消息列表：1
2025-11-03 19:59:49.793 [canalx-message-48] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：0 ms，分区号：3，消息列表：1
2025-11-03 19:59:49.793 [pool-5-thread-4] INFO com.alibaba.otter.canal.connector.core.util.StopWatch - batchId:149084875 发送到kafka总耗时:1 ms
2025-11-03 19:59:49.893 [pool-5-thread-4] INFO c.a.otter.canal.server.embedded.CanalServerWithEmbedded - getWithoutAck successfully, clientId:1001 batchSize:8000 real size is 1 and result is [batchId:149084876 , position:PositionRange[start=LogPosition[identity=LogIdentity[sourceAddress=pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306,slaveId=-1],postion=EntryPosition[included=false,journalName=mysql-bin.149522,position=501047715,serverId=100336765,gtid=,timestamp=1762199989000]],ack=,end=LogPosition[identity=LogIdentity[sourceAddress=pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306,slaveId=-1],postion=EntryPosition[included=false,journalName=mysql-bin.149522,position=501047715,serverId=100336765,gtid=,timestamp=1762199989000]],endSeq=34497139507]]
2025-11-03 19:59:49.893 [canalx-send-295622] INFO c.a.otter.canal.connector.core.producer.MQMessageUtils - 并行构建的binlog event花费时间：0 ms,并行构建线程数: 20
2025-11-03 19:59:49.894 [canalx-message-39] INFO c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - 单个线程发送消息到kafka单分区耗时：1 ms，分区号：3，消息列表：1
2025-11-03 19:59:49.894 [pool-5-thread-4] INFO com.alibaba.otter.canal.connector.core.util.StopWatch - batchId:149084876 发送到kafka总耗时:1 ms
2025-11-03 20:00:00.001 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - start heart beat....
2025-11-03 20:00:00.002 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - connect MysqlConnection to pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306...
2025-11-03 20:00:00.003 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - handshake initialization packet received, prepare the client authentication packet to send
2025-11-03 20:00:00.003 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - client authentication packet is sent out.
2025-11-03 20:00:00.013 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - connect MysqlConnection to pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306...
2025-11-03 20:00:00.014 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - handshake initialization packet received, prepare the client authentication packet to send
2025-11-03 20:00:00.014 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - client authentication packet is sent out.
2025-11-03 20:00:00.018 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - ---> begin to find start position, it will be long time for reset or first position
2025-11-03 20:00:00.018 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - prepare to find start position just last position
{"identity":{"slaveId":-1,"sourceAddress":{"address":"pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com","port":3306}},"postion":{"gtid":"","included":false,"journalName":"mysql-bin.149522","position":501047877,"serverId":100336765,"timestamp":1762199989000}}
2025-11-03 20:00:00.018 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - ---> find start position successfully, EntryPosition[included=false,journalName=mysql-bin.149522,position=501047877,serverId=100336765,gtid=,timestamp=1762199989000] cost : 0ms , the next step is binlog dump
2025-11-03 20:00:00.018 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - disConnect MysqlConnection to pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306...
2025-11-03 20:00:00.019 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - connect MysqlConnection to pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306...
2025-11-03 20:00:00.020 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - handshake initialization packet received, prepare the client authentication packet to send
2025-11-03 20:00:00.020 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.alibaba.otter.canal.parse.driver.mysql.MysqlConnector - client authentication packet is sent out.
2025-11-03 20:00:00.031 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.a.otter.canal.parse.inbound.mysql.MysqlConnection - Register slave RegisterSlaveCommandPacket[reportHost=172.19.251.29,reportPort=56646,reportUser=binlog_slave,reportPasswd=MP5qHQvX5gNMt2RitfsB,serverId=94826736,command=21]
2025-11-03 20:00:00.032 [destination = dimfeaturedb_afi_feature , address = pc-d9jbh70m69obiz3o9.rwlb.ap-southeast-5.rds.aliyuncs.com/172.19.39.69:3306 , EventParser] INFO c.a.otter.canal.parse.inbound.mysql.MysqlConnection - COM_BINLOG_DUMP with position:BinlogDumpCommandPacket[binlogPosition=501047877,slaveServerId=94826736,binlogFileName=mysql-bin.149522,command=18]
2025-11-03 20:00:00.037 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:00:00.952 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:04:12.092 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:08:51.482 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:13:42.850 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:16:34.098 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:19:19.960 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:22:10.611 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:24:51.325 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:27:35.434 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:30:26.628 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:33:12.473 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:36:00.755 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:40:08.450 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:44:44.915 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:49:14.372 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:52:32.625 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:55:25.637 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 20:58:16.728 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:01:13.941 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:04:03.707 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:06:52.131 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:09:47.668 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:12:30.949 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:15:16.566 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:18:08.835 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:20:56.615 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:23:43.564 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:26:33.453 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:29:26.087 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:32:21.119 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:35:25.256 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:38:25.156 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:41:26.014 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:44:28.509 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:47:13.296 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:49:11.653 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:51:09.102 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:53:04.331 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:54:58.235 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:56:53.003 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 21:58:47.339 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:00:43.106 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:02:36.546 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:04:28.871 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:06:21.915 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:08:18.635 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:10:16.447 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:12:08.023 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:14:01.601 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:17:31.605 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:22:35.963 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:28:28.120 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:34:43.384 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:40:34.632 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:46:29.601 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:52:27.290 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 22:58:08.516 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:03:32.417 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:08:43.621 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:13:53.148 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:19:10.073 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:22:29.392 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:26:40.049 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:31:39.686 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:36:38.810 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:39:35.992 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:41:15.089 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:43:22.000 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:47:40.064 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:52:01.574 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
2025-11-03 23:56:31.186 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
数据库做的增删改没有发送到kafka上,日志重复打印了
2025-11-03 23:56:31.186 [MultiStageCoprocessor-other-dimfeaturedb_afi_feature-0] INFO com.taobao.tddl.dbsync.binlog.LogEvent - common_header_len= 19, number_of_event_types= 38
需要手工重启canal任务才恢复发kakfka,找阿里工程师分析,polardb是没问题的,是canal端的问题,注:该问题遇到几次了,很奇怪,为什么重连后,不能恢复发kafka
Steps to reproduce
Expected behaviour
Actual behaviour
If there is an exception, please attach the exception trace:
Just put your stack trace here!