Refresh Iceberg Table metadata every 2 minutes instead of before each intermediate file written #37102

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

ahmedabu98 merged 3 commits into apache:master from JayajP:cache_optimize

Dec 16, 2025

Merged

Refresh Iceberg Table metadata every 2 minutes instead of before each intermediate file written #37102

Update staleness threshold to 2 minutes to match pr title

GitHub Actions / Test Results succeeded Dec 13, 2025 in 0s

All 7 tests pass in 1h 7m 39s

7 files ±0 7 suites ±0 1h 7m 39s ⏱️ +3s
7 tests ±0 7 ✅ ±0 0 💤 ±0 0 ❌ ±0
15 runs ±0 15 ✅ ±0 0 💤 ±0 0 ❌ ±0

Results for commit 8268afd. ± Comparison against earlier commit d4b0171.

Annotations

Check notice on line 0 in .github

github-actions / Test Results

7 tests found

There are 7 tests, see "Raw output" for the full list of tests.

Raw output


            org.apache.beam.examples.WindowedWordCountIT ‑ testWindowedWordCountInBatchDynamicSharding
org.apache.beam.examples.WindowedWordCountIT ‑ testWindowedWordCountInBatchStaticSharding
org.apache.beam.examples.WindowedWordCountIT ‑ testWindowedWordCountInStreamingStaticSharding
org.apache.beam.examples.WordCountIT ‑ testE2EWordCount
org.apache.beam.sdk.testutils.jvmverification.JvmVerification ‑ verifyCodeIsCompiledWithJava8
org.apache.beam.sdk.testutils.jvmverification.JvmVerification ‑ verifyRunningJVMVersionIs21
org.apache.beam.sdk.testutils.jvmverification.JvmVerification ‑ verifyTestCodeIsCompiledWithJava21

View more details on GitHub Actions