Skip to content

feat(blob): Remove blob external storage mode#393

Merged
lszskye merged 5 commits into
alibaba:mainfrom
lxy-9602:rm-blob-external
Jul 3, 2026
Merged

feat(blob): Remove blob external storage mode#393
lszskye merged 5 commits into
alibaba:mainfrom
lxy-9602:rm-blob-external

Conversation

@lxy-9602

@lxy-9602 lxy-9602 commented Jul 1, 2026

Copy link
Copy Markdown
Collaborator

Purpose

Linked issue: close #283

Remove the blob-external-storage-field and blob-external-storage-path functionality, following apache/paimon#8378.

This change:

  • Removes the external-storage blob table options from public option definitions and CoreOptions.
  • Removes external-storage blob schema validation.
  • Deletes ExternalStorageBlobWriter and its write-path integration from AppendOnlyWriter.
  • Simplifies BlobFileContext to only classify descriptor, view, inline, and regular blob-file fields.
  • Simplifies blob writer plumbing by removing the now-unused WriteConsumer and blob path creator hooks.
  • Keeps existing descriptor/blob-view/raw blob behavior unchanged.
  • Keeps historical test data, but removes the deleted options from fixture schema files.

Tests

API and Format

This removes two public table options from the C++ API:

  • blob-external-storage-field
  • blob-external-storage-path

No storage format change is introduced. Existing BlobDescriptor data whose URI points outside the main table path can still be read as long as the referenced files exist.

Documentation

Generative AI tooling

Generated-by: OpenAI Codex (GPT-5)

Comment thread test/inte/blob_table_inte_test.cpp

@lszskye lszskye left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@lszskye lszskye merged commit 86cc620 into alibaba:main Jul 3, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature] Support multiple blob fields and BlobView/descriptor-inline mode in paimon-cpp

2 participants