Skip to content

[Refactor](Multi Catalog) Unified meta cache framework with engine adapters#60687

Closed
suxiaogang223 wants to merge 1 commit intoapache:masterfrom
suxiaogang223:unify-meta-cache
Closed

[Refactor](Multi Catalog) Unified meta cache framework with engine adapters#60687
suxiaogang223 wants to merge 1 commit intoapache:masterfrom
suxiaogang223:unify-meta-cache

Conversation

@suxiaogang223
Copy link
Contributor

@suxiaogang223 suxiaogang223 commented Feb 11, 2026

What problem does this PR solve?

Part of #60686

Summary

Introduce a unified metadata cache framework (UnifiedMetaCacheMgr) and migrate Paimon / Iceberg caches as the first two engine adapters.

Key Changes

  • Add framework abstractions: UnifiedMetaCacheMgr, CatalogMetaCache, EngineMetaCache, CacheModule, CacheSpec
  • Add engine adapters: PaimonEngineCache, IcebergEngineCache
  • Refactor Paimon / Iceberg schema caching into snapshot cache (embed schema into snapshot cache value)
  • Route PaimonUtils / IcebergUtils through engine cache
  • Migrate remaining Iceberg call sites to engine cache path

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@suxiaogang223 suxiaogang223 changed the title [Refactor](external) Unified meta cache framework with engine adapters [Refactor](Multi-Catalog) Unified meta cache framework with engine adapters Feb 11, 2026
@suxiaogang223 suxiaogang223 changed the title [Refactor](Multi-Catalog) Unified meta cache framework with engine adapters [Refactor](Multi Catalog) Unified meta cache framework with engine adapters Feb 11, 2026
@suxiaogang223
Copy link
Contributor Author

run external

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 22.21% (175/788) 🎉
Increment coverage report
Complete coverage report

@suxiaogang223 suxiaogang223 marked this pull request as ready for review February 24, 2026 07:54
@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 22.21% (175/788) 🎉
Increment coverage report
Complete coverage report

@suxiaogang223
Copy link
Contributor Author

run external

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 56.01% (578/1032) 🎉
Increment coverage report
Complete coverage report

@suxiaogang223
Copy link
Contributor Author

run external

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants