Skip to content

Conversation

@yaauie
Copy link
Contributor

@yaauie yaauie commented Sep 23, 2025

By increasing the size of the connection pool from the Sequel-default 4 to 16, we increase the max parallelism of pipelines that are using this filter by four- fold, reducing the situations where a pipeline's total throughput is constrained by this plugin's connection pool to the internal Derby DB.

We also increase the pool timeout from the Sequel-default 5 seconds to 30 seconds, so that failures to immediately acquire a connection don't result in failed lookups.

This issue is meant to mitigate the root-cause beneath #186 without expanding the scope of configuration options for the jdbc_static filter, which would be a substantial effort.

By increasing the size of the connection pool from the Sequel-default 4 to 16,
we increase the parallelism of pipelines that are using this filter by four-
fold, reducing the situations where a pipeline's total throughput is
constrained by this plugin's connection pool to the internal Derby DB.

We also increase the pool timeout from the Sequel-default 5 seconds to 30
seconds, so that failures to immediately acquire a connection don't result in
failed lookups.
@yaauie yaauie requested a review from robbavey September 23, 2025 21:58
Copy link
Member

@robbavey robbavey left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yaauie yaauie merged commit 590a460 into logstash-plugins:main Sep 30, 2025
3 checks passed
@yaauie yaauie deleted the static-filter-derby-max-connections branch September 30, 2025 15:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants