Bump clickhouse client to 0.9.4 #69829

bouk · 2025-11-23T13:19:36Z

This should fix issues when loading many tables at the same time. I've not tested this, since I don't have airbyte running locally, just using it

What

I kept getting this issue:

2025-11-22 19:12:40 destination ERROR com.clickhouse.client.api.ClientException: Query request failed after attempts: 4 - Duration: 40006856041
2025-11-22 19:12:40 destination ERROR 	at com.clickhouse.client.api.Client.lambda$query$5(Client.java:1590)
2025-11-22 19:12:40 destination ERROR 	at com.clickhouse.client.api.Client.runAsyncOperation(Client.java:1982)
2025-11-22 19:12:40 destination ERROR 	at com.clickhouse.client.api.Client.query(Client.java:1593)
2025-11-22 19:12:40 destination ERROR 	at com.clickhouse.client.api.Client.query(Client.java:1479)
2025-11-22 19:12:40 destination ERROR 	at com.clickhouse.client.api.Client.execute(Client.java:1898)
2025-11-22 19:12:40 destination ERROR 	at io.airbyte.integrations.destination.clickhouse.client.ClickhouseAirbyteClient.execute$io_airbyte_airbyte_integrations_connectors_destination_clickhouse(ClickhouseAirbyteClient.kt:275)
2025-11-22 19:12:40 destination ERROR 	at io.airbyte.integrations.destination.clickhouse.client.ClickhouseAirbyteClient.createTable-9FR0I8Y(ClickhouseAirbyteClient.kt:60)
2025-11-22 19:12:40 destination ERROR 	at io.airbyte.cdk.load.orchestration.db.direct_load_table.DirectLoadTableAppendTruncateStreamLoader.start(DirectLoadTableStreamLoader.kt:217)
2025-11-22 19:12:40 destination ERROR 	at io.airbyte.cdk.load.dataflow.DestinationLifecycle$initializeIndividualStreams$1$result$1$1.invokeSuspend(DestinationLifecycle.kt:68)
2025-11-22 19:12:40 destination ERROR 	at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:33)
2025-11-22 19:12:40 destination ERROR 	at kotlinx.coroutines.DispatchedTask.run(DispatchedTask.kt:100)
2025-11-22 19:12:40 destination ERROR 	at kotlinx.coroutines.scheduling.CoroutineScheduler.runSafely(CoroutineScheduler.kt:586)
2025-11-22 19:12:40 destination ERROR 	at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.executeTask(CoroutineScheduler.kt:829)
2025-11-22 19:12:40 destination ERROR 	at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.runWorker(CoroutineScheduler.kt:717)
2025-11-22 19:12:40 destination ERROR 	at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.run(CoroutineScheduler.kt:704)
2025-11-22 19:12:40 destination ERROR 	Suppressed: com.clickhouse.client.api.ClientException: Query request failed after attempts: 4 - Duration: 40006892918
2025-11-22 19:12:40 destination ERROR 		... 15 more
2025-11-22 19:12:40 destination ERROR 	Caused by: com.clickhouse.client.api.ConnectionInitiationException: Query request failed (Attempt: 4/4 - Duration: 40005900881)
2025-11-22 19:12:40 destination ERROR 		at com.clickhouse.client.api.internal.HttpAPIClientHelper.wrapException(HttpAPIClientHelper.java:668)
2025-11-22 19:12:40 destination ERROR 		at com.clickhouse.client.api.Client.lambda$query$5(Client.java:1579)
2025-11-22 19:12:40 destination ERROR 		... 14 more
2025-11-22 19:12:40 destination ERROR 	Caused by: org.apache.hc.core5.http.ConnectionRequestTimeoutException: Timeout deadline: 10000 MILLISECONDS, actual: 10000 MILLISECONDS
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.InternalExecRuntime.acquireEndpoint(InternalExecRuntime.java:120)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ConnectExec.execute(ConnectExec.java:125)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ProtocolExec.execute(ProtocolExec.java:192)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.HttpRequestRetryExec.execute(HttpRequestRetryExec.java:113)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ContentCompressionExec.execute(ContentCompressionExec.java:152)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.RedirectExec.execute(RedirectExec.java:116)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.InternalHttpClient.doExecute(InternalHttpClient.java:170)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.CloseableHttpClient.execute(CloseableHttpClient.java:87)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.CloseableHttpClient.execute(CloseableHttpClient.java:55)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.classic.HttpClient.executeOpen(HttpClient.java:183)
2025-11-22 19:12:40 destination ERROR 		at com.clickhouse.client.api.internal.HttpAPIClientHelper.executeRequest(HttpAPIClientHelper.java:415)
2025-11-22 19:12:40 destination ERROR 		at com.clickhouse.client.api.Client.lambda$query$5(Client.java:1550)
2025-11-22 19:12:40 destination ERROR 		... 14 more
2025-11-22 19:12:40 destination ERROR 	Suppressed: com.clickhouse.client.api.ClientException: Query request failed after attempts: 4 - Duration: 40005155479
2025-11-22 19:12:40 destination ERROR 		... 15 more
2025-11-22 19:12:40 destination ERROR 	Caused by: com.clickhouse.client.api.ConnectionInitiationException: Query request failed (Attempt: 4/4 - Duration: 40004545840)
2025-11-22 19:12:40 destination ERROR 		at com.clickhouse.client.api.internal.HttpAPIClientHelper.wrapException(HttpAPIClientHelper.java:668)
2025-11-22 19:12:40 destination ERROR 		at com.clickhouse.client.api.Client.lambda$query$5(Client.java:1579)
2025-11-22 19:12:40 destination ERROR 		... 14 more
2025-11-22 19:12:40 destination ERROR 	Caused by: org.apache.hc.core5.http.ConnectionRequestTimeoutException: Timeout deadline: 10000 MILLISECONDS, actual: 10000 MILLISECONDS
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.InternalExecRuntime.acquireEndpoint(InternalExecRuntime.java:120)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ConnectExec.execute(ConnectExec.java:125)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ProtocolExec.execute(ProtocolExec.java:192)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.HttpRequestRetryExec.execute(HttpRequestRetryExec.java:113)
2025-11-22 19:12:40 destination ERROR 		at org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)

When loading 15 schemas at the same time, I could see from the logs it was doing 20 queries at once:

2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`locations`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`deputylocations0d04ec724b67951a327198bda65c11e9`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`employees`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`deputyemployees4eb807a911792b3f0022d4ea79ecab1a`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`award_lists`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`deputyaward_lists3c7dfbfa392a7d604c66c476465f3b19`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`departments`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`deputydepartments699765aac54e3da18eccbdd8a47438a9`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`timesheets`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`deputytimesheets803d3bffdc18e5d60d6c9b1f24b803bc`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`tasks`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`deputytasks22ec78dd68cf2ee4e4aee4824006aa3d`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`news_feed`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`deputynews_feeda359f9168c1ddc04cf7dab83850522da`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`addresses`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`deputyaddresses4954d4a09bcc31137983062d3a2db88f`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`categories`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`deputycategories404466076676daa8976abd426a8aae7a`;
2025-11-22 19:02:39 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`comments`;
2025-11-22 19:02:40 destination INFO main i.a.i.d.c.c.ClickhouseSqlGenerator(andLog):52         SELECT count(1) cnt FROM `deputy`.`deputycommentsde4cb354b908b771598c59fb1e2c72c8`;

and this seems to match this clickhouse-java issue I found: ClickHouse/clickhouse-java#1741

How

Upgrade clickhouse client to include the latest fixes

Can this PR be safely reverted and rolled back?

YES 💚
NO ❌

This should fix issues when loading many tables at the same time, see ClickHouse/clickhouse-java#1741

CLAassistant · 2025-11-23T13:19:42Z

All committers have signed the CLA.

github-actions · 2025-11-23T13:20:00Z

👋 Welcome to Airbyte!

Thank you for your contribution from bouk/airbyte! We're excited to have you in the Airbyte community.

Helpful Resources

PR Guidelines: Check our guidelines for contributions.
Breaking Changes Guide: Guide to breaking changes, migration guides, and upgrade deadlines.
Developing Connectors Locally: Learn how to set up your environment and develop connectors locally.
If you enable BYO Connector Credentials within your fork, you can view your test results here:

PR Slash Commands

As needed or by request, Airbyte Maintainers can execute the following slash commands on your PR:

/format-fix - Fixes most formatting issues.
/bump-version - Bumps connector versions.
/run-connector-tests - Runs connector tests.
/run-cat-tests - Runs CAT tests.
/run-live-tests - Runs live tests for the modified connector(s).
/run-regression-tests - Runs regression tests for the modified connector(s).
/build-connector-images - Builds and publishes a pre-release docker image for the modified connector(s).

If you have any questions, feel free to ask in the PR comments or join our Slack community.

Tips for Working with CI

Pre-Release Checks. Please pay attention to these, as they contain standard checks on the metadata.yaml file, docs requirements, etc. If you need help resolving a pre-release check, please ask a maintainer.
- Note: If you are creating a new connector, please be sure to replace the default logo.svg file with a suitable icon.
Connector CI Tests. Some failures here may be expected if your tests require credentials. Please review these results to ensure (1) unit tests are passing, if applicable, and (2) integration tests pass to the degree possible and expected.
(Optional.) BYO Connector Credentials for tests in your fork. You can optionally set up your fork with BYO credentials for your connector. This can significantly speed up your review, ensuring your changes are fully tested before the maintainers begin their review.

📝 Edit this welcome message.

DanyloGL · 2025-11-24T16:17:09Z

/run-connector-tests

Connector CI Tests Started

These tests will leverage Airbyte's integration test credentials.

Check job output.
✅ Connector CI Tests job completed successfully. See logs for details.

DanyloGL · 2025-11-24T16:29:05Z

@bouk thank you for your contribution!
Could you please increase dockerImageTag in metadata.yaml file and update changelog section in docs file?

bouk · 2025-11-24T19:37:21Z

done!

Bump clickhouse client to 0.9.4

fa43c86

This should fix issues when loading many tables at the same time, see ClickHouse/clickhouse-java#1741

bouk requested a review from a team as a code owner November 23, 2025 13:19

octavia-squidington-iii added community connectors/destination/clickhouse labels Nov 23, 2025

github-project-automation bot added this to 🧑‍🏭 Community Pull Requests Nov 23, 2025

github-project-automation bot moved this to New PRs in 🧑‍🏭 Community Pull Requests Nov 23, 2025

DanyloGL moved this from New PRs to Waiting Contributor in 🧑‍🏭 Community Pull Requests Nov 24, 2025

bouk mentioned this pull request Nov 24, 2025

Update docker tag and changelog bouk/airbyte#1

Closed

2 tasks

Bump Docker image and add changelog

c88d9e4

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Bump clickhouse client to 0.9.4 #69829

Bump clickhouse client to 0.9.4 #69829

bouk commented Nov 23, 2025

Uh oh!

CLAassistant commented Nov 23, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Nov 23, 2025

Uh oh!

DanyloGL commented Nov 24, 2025 •

edited by github-actions bot

Loading

Uh oh!

DanyloGL commented Nov 24, 2025

Uh oh!

bouk commented Nov 24, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Bump clickhouse client to 0.9.4 #69829

Are you sure you want to change the base?

Bump clickhouse client to 0.9.4 #69829

Conversation

bouk commented Nov 23, 2025

What

How

Can this PR be safely reverted and rolled back?

Uh oh!

CLAassistant commented Nov 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Nov 23, 2025

👋 Welcome to Airbyte!

Helpful Resources

PR Slash Commands

Tips for Working with CI

Uh oh!

DanyloGL commented Nov 24, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

DanyloGL commented Nov 24, 2025

Uh oh!

bouk commented Nov 24, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

CLAassistant commented Nov 23, 2025 •

edited

Loading

DanyloGL commented Nov 24, 2025 •

edited by github-actions bot

Loading