Maxwell's reading of MySQL's binlog output to Kafka has a delay of one hour #2175
Unanswered
Songrenjian
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hello everyone, when I use Maxwell to read MySQL Binlog and output it to Kafka's topic, sometimes the delay can reach an hour, and after a while, it will automatically catch up, but the delay is gone again. For example, in MySQL, I entered data for 11 am, but in my Kafka topic, I read data for 10 am. Below is my Maxwell configuration file. May I ask how I can solve this problem?
tl;dr config
log_level=info
producer=kafka
#ddl_kafka_topic=maxwell_ddl
#output_ddl=true
#init_position=binlog.000155:426808694:0
host=XXXXXXXXXXXXX
user=XXXXXXXXXXXXX
password=XXXXXXXXXXXXX
port=3306
client_id=XXXXXXXXXXXXX
schema_database=XXXXXXXXXXXXX
replication_host=XXXXXXXXXXXXX
replication_user=XXXXXXXXXXXXX
replication_password=XXXXXXXXXXXXX
replication_port=3306
kafka.bootstrap.servers=XXXXXXXXXXXXX
kafka.compression.type=snappy
kafka.retries=5
kafka.acks=all
kafka.enable.idempotence=true
kafka.max.request.size=10485760
kafka_topic=XXXXXXXXXXXXX
jdbc_options = useSSL=false&serverTimezone=Asia/Shanghai
replication_jdbc_options = useSSL=false&serverTimezone=Asia/Shanghai
replica_server_id=XXXXXXXXXXXXX
filter=exclude: .,include:XXXXXXXXXXXXX
output_binlog_position=true
output_primary_keys=true
output_primary_key_columns=true
Beta Was this translation helpful? Give feedback.
All reactions