Skip to content

UnicodeDecodeError - 'utf-8' codec can't decode byte 0xff #57

@itziklavon

Description

@itziklavon

Hi, i'm getting the fillowing error from the producer(using docker compose, with dev tag, as sentry breaks latest tag)
what might cause it?
i see producer is connected, and pulling data + sending to queue
some records have this error, is there a way to overcome it?

producer_1  | Traceback (most recent call last):
producer_1  |   File "/usr/local/bin/synch", line 5, in <module>
producer_1  |     cli()
producer_1  |   File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1137, in __call__
producer_1  |     return self.main(*args, **kwargs)
producer_1  |   File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1062, in main
producer_1  |     rv = self.invoke(ctx)
producer_1  |   File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1668, in invoke
producer_1  |     return _process_result(sub_ctx.command.invoke(sub_ctx))
producer_1  |   File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
producer_1  |     return ctx.invoke(self.callback, **ctx.params)
producer_1  |   File "/usr/local/lib/python3.9/site-packages/click/core.py", line 763, in invoke
producer_1  |     return __callback(*args, **kwargs)
producer_1  |   File "/usr/local/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
producer_1  |     return f(get_current_context(), *args, **kwargs)
producer_1  |   File "/synch/synch/cli.py", line 91, in produce
producer_1  |     reader.start_sync(broker)
producer_1  |   File "/synch/synch/reader/mysql.py", line 109, in start_sync
producer_1  |     for schema, table, event, file, pos in self._binlog_reading(
producer_1  |   File "/synch/synch/reader/mysql.py", line 178, in _binlog_reading
producer_1  |     for row in binlog_event.rows:
producer_1  |   File "/usr/local/lib/python3.9/site-packages/pymysqlreplication/row_event.py", line 433, in rows
producer_1  |     self._fetch_rows()
producer_1  |   File "/usr/local/lib/python3.9/site-packages/pymysqlreplication/row_event.py", line 428, in _fetch_rows
producer_1  |     self.__rows.append(self._fetch_one_row())
producer_1  |   File "/usr/local/lib/python3.9/site-packages/pymysqlreplication/row_event.py", line 481, in _fetch_one_row
producer_1  |     row["values"] = self._read_column_data(self.columns_present_bitmap)
producer_1  |   File "/usr/local/lib/python3.9/site-packages/pymysqlreplication/row_event.py", line 132, in _read_column_data
producer_1  |     values[name] = self.__read_string(1, column)
producer_1  |   File "/usr/local/lib/python3.9/site-packages/pymysqlreplication/row_event.py", line 224, in __read_string
producer_1  |     string = string.decode(encoding)
producer_1  | UnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 0: invalid start byte

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions