Skip to content

[MINOR] Respect Spark bloom filter config#11561

Open
jinchengchenghh wants to merge 1 commit intoapache:mainfrom
jinchengchenghh:bloom_config
Open

[MINOR] Respect Spark bloom filter config#11561
jinchengchenghh wants to merge 1 commit intoapache:mainfrom
jinchengchenghh:bloom_config

Conversation

@jinchengchenghh
Copy link
Contributor

Respect Spark three configs, firstly check the Spark config, if not exists, check the Gluten velox config with prefix park.gluten.sql.columnar.backend.velox., if not exists, Velox will use its default config value.

spark.sql.optimizer.runtime.bloomFilter.expectedNumItems
spark.sql.optimizer.runtime.bloomFilter.numBits
spark.sql.optimizer.runtime.bloomFilter.maxNumBits

@github-actions github-actions bot added CORE works for Gluten Core VELOX labels Feb 4, 2026
@github-actions
Copy link

github-actions bot commented Feb 4, 2026

Run Gluten Clickhouse CI on x86

@FelixYBW
Copy link
Contributor

We may remove the gluten config if there are existed ones for Spark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CORE works for Gluten Core VELOX

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants