sqlserver com.microsoft.sqlserver.jdbc.SQLServerException: Connection reset #2548
Unanswered
lschampion
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
error: sqlserver com.microsoft.sqlserver.jdbc.SQLServerException: Connection reset
after a few monent check, I found:
(1) sqlserver database is high avaliable.
(2) this error is occur before the database switch to slaver from master.
cdc version: 2.2.1
flink version: 1.13.6
sqlserver version: Microsoft SQL Server 2019 (RTM-CU19) (KB5023049) - 15.0.4298.1 (X64)
Jan 27 2023 16:44:09
Copyright (C) 2019 Microsoft Corporation
Enterprise Edition: Core-based Licensing (64-bit) on Windows Server 2019 Datacenter 10.0 (Build 17763: ) (Hypervisor)
java version: 1.8
after 10+ day running sqlserver connector of flink cdc,report an error:
Error log：
2023-10-12 16:08:10,181 ERROR io.debezium.pipeline.ErrorHandler [] - Producer failure
com.microsoft.sqlserver.jdbc.SQLServerException: Connection reset
at com.microsoft.sqlserver.jdbc.SQLServerConnection.terminate(SQLServerConnection.java:2892) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2031) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSReader.readPacket(IOBuffer.java:6418) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.startResponse(IOBuffer.java:7579) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:590) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:522) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:7194) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:2935) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:248) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:223) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeQuery(SQLServerPreparedStatement.java:444) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.jdbc.JdbcConnection.prepareQueryAndMap(JdbcConnection.java:740) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerConnection.getMaxLsnResult(SqlServerConnection.java:149) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:135) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:152) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:119) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0-internal]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0-internal]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0-internal]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0-internal]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0-internal]
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:210) ~[?:1.8.0-internal]
at java.net.SocketInputStream.read(SocketInputStream.java:141) ~[?:1.8.0-internal]
at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2023) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
... 19 more
2023-10-12 16:08:10,238 INFO io.debezium.pipeline.ChangeEventSourceCoordinator [] - Finished streaming
2023-10-12 16:08:10,238 INFO io.debezium.pipeline.metrics.StreamingChangeEventSourceMetrics [] - Connected metrics set to 'false'
2023-10-12 16:08:10,561 WARN io.debezium.connector.common.BaseSourceTask [] - Going to restart connector after 10 sec. after a retriable exception
2023-10-12 16:08:10,608 INFO io.debezium.jdbc.JdbcConnection [] - Connection gracefully closed
2023-10-12 16:08:10,609 INFO io.debezium.jdbc.JdbcConnection [] - Connection gracefully closed
2023-10-12 16:08:10,610 INFO io.debezium.embedded.EmbeddedEngine [] - Retrieable exception thrown, connector will be restarted
com.ververica.cdc.connectors.shaded.org.apache.kafka.connect.errors.RetriableException: An exception occurred in the change event producer. This connector will be restarted.
at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:38) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:292) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:152) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:119) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0-internal]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0-internal]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0-internal]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0-internal]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0-internal]
Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: Connection reset
at com.microsoft.sqlserver.jdbc.SQLServerConnection.terminate(SQLServerConnection.java:2892) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2031) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSReader.readPacket(IOBuffer.java:6418) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.startResponse(IOBuffer.java:7579) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:590) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:522) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:7194) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:2935) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:248) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:223) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeQuery(SQLServerPreparedStatement.java:444) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.jdbc.JdbcConnection.prepareQueryAndMap(JdbcConnection.java:740) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerConnection.getMaxLsnResult(SqlServerConnection.java:149) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:135) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
... 7 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:210) ~[?:1.8.0-internal]
at java.net.SocketInputStream.read(SocketInputStream.java:141) ~[?:1.8.0-internal]
at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2023) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSReader.readPacket(IOBuffer.java:6418) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.startResponse(IOBuffer.java:7579) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:590) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:522) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:7194) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:2935) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:248) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:223) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeQuery(SQLServerPreparedStatement.java:444) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.jdbc.JdbcConnection.prepareQueryAndMap(JdbcConnection.java:740) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerConnection.getMaxLsnResult(SqlServerConnection.java:149) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:135) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
... 7 more
2023-10-12 16:08:10,610 INFO io.debezium.connector.common.BaseSourceTask [] - Awaiting end of restart backoff period after a retriable error
and after about 7 times reties, cdc finaly stop the connector:
2023-10-12 16:08:20,663 WARN io.debezium.relational.history.DatabaseHistoryMetrics [] - Unable to unregister the MBean 'debezium.sql_server:type=connector-metrics,context=schema-history,server=sqlserver_transaction_log_source': debezium.sql_server:type=connector-metrics,context=schema-history,server=sqlserver_transaction_log_source
2023-10-12 16:08:20,664 ERROR com.ververica.cdc.debezium.internal.Handover [] - Reporting error:
java.lang.IllegalStateException: Retrieve schema history failed, the schema records for engine b5768114-1849-43ee-83e8-12b259a398dc has been removed, this might because the debezium engine has been shutdown due to other errors.
at com.ververica.cdc.debezium.utils.DatabaseHistoryUtil.retrieveHistory(DatabaseHistoryUtil.java:77) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at com.ververica.cdc.debezium.internal.FlinkDatabaseSchemaHistory.configure(FlinkDatabaseSchemaHistory.java:82) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.relational.HistorizedRelationalDatabaseConnectorConfig.getDatabaseHistory(HistorizedRelationalDatabaseConnectorConfig.java:105) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.relational.HistorizedRelationalDatabaseSchema.(HistorizedRelationalDatabaseSchema.java:39) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerDatabaseSchema.(SqlServerDatabaseSchema.java:34) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.sqlserver.SqlServerConnectorTask.start(SqlServerConnectorTask.java:84) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:130) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.common.BaseSourceTask.startIfNeededAndPossible(BaseSourceTask.java:207) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.connector.common.BaseSourceTask.poll(BaseSourceTask.java:148) ~[blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:788) [blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at io.debezium.embedded.ConvertingEngineBuilder$2.run(ConvertingEngineBuilder.java:188) [blob_p-882043fa23f76878b20c44e7bc6b058664a03654-d5d4b0c917c9d1d91c28e851110bd492:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0-internal]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0-internal]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0-internal]
2023-10-12 16:08:20,665 INFO io.debezium.embedded.EmbeddedEngine [] - Stopping the embedded engine
at com.ververica.cdc.debezium.utils.DatabaseHistoryUtil.retrieveHistory(DatabaseHistoryUtil.java:77)
at com.ververica.cdc.debezium.internal.FlinkDatabaseSchemaHistory.configure(FlinkDatabaseSchemaHistory.java:82)
at io.debezium.relational.HistorizedRelationalDatabaseConnectorConfig.getDatabaseHistory(HistorizedRelationalDatabaseConnectorConfig.java:105)
at io.debezium.relational.HistorizedRelationalDatabaseSchema.(HistorizedRelationalDatabaseSchema.java:39)
at io.debezium.connector.sqlserver.SqlServerDatabaseSchema.(SqlServerDatabaseSchema.java:34)
at io.debezium.connector.sqlserver.SqlServerConnectorTask.start(SqlServerConnectorTask.java:84)
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:130)
at io.debezium.connector.common.BaseSourceTask.startIfNeededAndPossible(BaseSourceTask.java:207)
at io.debezium.connector.common.BaseSourceTask.poll(BaseSourceTask.java:148)
at io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:788)
at io.debezium.embedded.ConvertingEngineBuilder$2.run(ConvertingEngineBuilder.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2023-10-12 16:08:20,702 INFO io.debezium.embedded.EmbeddedEngine [] - Stopping the embedded engine
Beta Was this translation helpful? Give feedback.
All reactions