Skip to content

feat(hf): support writing and reading from both http and xet#7185

Open
kszucs wants to merge 20 commits intoapache:mainfrom
kszucs:hf-revamp
Open

feat(hf): support writing and reading from both http and xet#7185
kszucs wants to merge 20 commits intoapache:mainfrom
kszucs:hf-revamp

Conversation

@kszucs
Copy link
Member

@kszucs kszucs commented Feb 9, 2026

Which issue does this PR close?

Work-in-progress, but generally:

  • add writing support
  • support reading using the xet protocol (opt-in)
  • support writing using the xet protocol (opt-in)

I opened the PR for better visibility and early feedback.

Depends on huggingface/xet-core#642

Rationale for this change

What changes are included in this PR?

Are there any user-facing changes?

AI Usage Statement

@kszucs kszucs marked this pull request as ready for review February 10, 2026 09:12
@dosubot dosubot bot added size:XXL This PR changes 1000+ lines, ignoring generated files. releases-note/feat The PR implements a new feature or has a title that begins with "feat" labels Feb 10, 2026
#[serde(default)]
#[non_exhaustive]
pub struct HuggingfaceConfig {
pub struct HfConfig {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe do the rename in a separate PR?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can open one now. We can merge it, and you can rebase this PR onto that merged one. Then we have fewer changesets to review.

I have no strong feelings about either name. But this can be a breaking change that needs to be documented.

@kszucs
Copy link
Member Author

kszucs commented Feb 11, 2026

I'm still working on a couple of things, like implementing oio::Write instead of OneShotWrite which requires some additional changes in my xet-core PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

releases-note/feat The PR implements a new feature or has a title that begins with "feat" size:XXL This PR changes 1000+ lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants