Skip to content

clickhouse-mysql real time insert data from MySQL into ClickHouse don't work #185

@zhituanchen

Description

@zhituanchen

hi,team:
There is a situation:
1.Automatically create target table in ClickHouse and migrate existing data from MySQL to ClickHouse is ok:
clickhouse-mysql
--src-server-id=166
--src-wait
--nice-pause=1
--src-host=127.0.0.1
--src-user=clickhousereader
--src-password=12345
--src-tables=airline.ontime
--dst-host=127.0.0.1
--dst-create-table
--migrate-table
--pump-data
--csvpool
2.The script is runing . other session insert a data on mysql.But in ClickHouse can't select the data.
info:
[root@mytestuse clickhouse]# clickhouse-mysql \

--src-server-id=166 \
--src-wait \
--nice-pause=1 \
--src-host=127.0.0.1 \
--src-user=clickhousereader \
--src-password=12345 \
--src-tables=airline.ontime \
--dst-host=127.0.0.1 \
--dst-create-table \
--migrate-table \
--pump-data \
--csvpool

2020-09-10 16:12:26,348/1599725546.348313:INFO:Starting
2020-09-10 16:12:26,348/1599725546.348550:DEBUG:{'app': {'binlog_position_file': None,
'config_file': '/etc/clickhouse-mysql/clickhouse-mysql.conf',
......
2020-09-10 16:12:26,498/1599725546.498071:INFO:PoolWriter()
2020-09-10 16:12:26,498/1599725546.498164:DEBUG:Check events in binlog stream
2020-09-10 16:12:26,498/1599725546.498232:DEBUG:undef
2020-09-10 16:12:26,501/1599725546.501361:WARNING:Got an exception, skip it in blocking mode
2020-09-10 16:12:26,501/1599725546.501451:WARNING:'Connection' object has no attribute 'wfile'
2020-09-10 16:12:27,502/1599725547.502636:DEBUG:Check events in binlog stream
2020-09-10 16:12:27,502/1599725547.502819:DEBUG:Pre-start binlog position: mysqlbin.000032:4086
2020-09-10 16:12:27,506/1599725547.506407:WARNING:Got an exception, skip it in blocking mode
2020-09-10 16:12:27,506/1599725547.506510:WARNING:'Connection' object has no attribute 'wfile'
2020-09-10 16:12:28,507/1599725548.507796:DEBUG:Check events in binlog stream
.....
2020-09-10 16:12:39,565/1599725559.565709:DEBUG:Pre-start binlog position: mysqlbin.000032:4086
2020-09-10 16:12:39,570/1599725559.570876:WARNING:Got an exception, skip it in blocking mode
2020-09-10 16:12:39,571/1599725559.571060:WARNING:'Connection' object has no attribute 'wfile'
^C2020-09-10 16:12:39,715/1599725559.715296:INFO:SIGINT received. Time to exit.
2020-09-10 16:12:39,715/1599725559.715575:INFO:start 1599725546
2020-09-10 16:12:39,715/1599725559.715738:INFO:end 1599725559
2020-09-10 16:12:39,715/1599725559.715876:INFO:len 13
[root@mytestuse clickhouse]#

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions