Open
Conversation
Contributor
|
Important Review skippedBot user detected. To trigger a single review, invoke the You can disable this status message by setting the
Comment |
d966ca3 to
0f9d723
Compare
257dfbe to
29d0522
Compare
60d9578 to
8d8266b
Compare
8d8266b to
0d86a6d
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
==0.36.0→==1.5.0Release Notes
huggingface/huggingface_hub (huggingface_hub)
v1.5.0: [v1.5.0]: Buckets API, Agent-first CLI, Spaces Hot-Reload and moreCompare Source
This release introduces major new features including Buckets (xet-based large scale object storage), CLI Extensions, Space Hot-Reload, and significant improvements for AI coding agents. The CLI has been completely overhauled with centralized error handling, better help output, and new commands for collections, papers, and more.
🪣 Buckets: S3-like Object Storage on the Hub
Buckets provide S3-like object storage on Hugging Face, powered by the Xet storage backend. Unlike repositories (which are git-based and track file history), buckets are remote object storage containers designed for large-scale files with content-addressable deduplication. Use them for training checkpoints, logs, intermediate artifacts, or any large collection of files that doesn't need version control.
The Buckets API includes full CLI and Python support for creating, listing, moving, and deleting buckets; uploading, downloading, and syncing files; and managing bucket contents with include/exclude patterns.
hfinstall by @julien-c in #3846📚 Documentation: Buckets guide
🤖 AI Agent Support
This release includes several features designed to improve the experience for AI coding agents (Claude Code, OpenCode, Cursor, etc.):
HF_DEBUG=1for full traces) by @hanouticelina in #3754hf skills addcommand now installs a compact skill (~1.2k tokens vs ~12k before) by @hanouticelina in #3802hf jobs logs: Prints available logs and exits by default; use-fto stream by @davanstrien in #3783hf skills addCLI command by @julien-c in #3741hf skills addinstalls to central location with symlinks by @hanouticelina in #3755🔥 Space Hot-Reload (Experimental)
Hot-reload Python files in a Space without a full rebuild and restart. This is useful for rapid iteration on Gradio apps.
🖥️ CLI Improvements
New Commands
hf papers lsto list daily papers on the Hub by @julien-c in #3723hf collectionscommands (ls, info, create, update, delete, add-item, update-item, delete-item) by @Wauplin in #3767CLI Extensions
Introduce an extension mechanism to the
hfCLI. Extensions are standalone executables hosted in GitHub repositories that users can install, run, and remove with simple commands. Inspired bygh extension.hf extensionby @hanouticelina in #3805hf extalias by @hanouticelina in #3836Output Format Options
--format {table,json}and-q/--quiettohf models ls,hf datasets ls,hf spaces ls,hf endpoints lsby @hanouticelina in #3735hf jobs psoutput with standard CLI pattern by @davanstrien in #3799--expandfield by @hanouticelina in #3760Usability
hfCLI help output with examples and documentation links by @hanouticelina in #3743-has short alias for--helpby @assafvayner in #3800--versionflag by @Wauplin in #3784--typeas alias for--repo-typeby @Wauplin in #3835hf download repo_id subfolder/now works as expected by @Wauplin in #3822Jobs CLI
List available hardware:
Also added a ton of fixes and small QoL improvements.
torchrun,accelerate launch) by @lhoestq in #3674hf jobs hardwareby @Wauplin in #3693!=) by @lhoestq in #3742hf jobscommands crashing without a TTY by @davanstrien in #3782🤖 Inference
dimensions&encoding_formatparameter to InferenceClient for output embedding size by @mishig25 in #3671image-to-imagecompatibility with different model schemas by @hanouticelina in #3749🔧 Other QoL Improvements
EvalResultEntry,parse_eval_result_entries) by @hanouticelina in #3633EvalResultEntryby @hanouticelina in #3694num_papersfield to Organization class by @cfahlgren1 in #3695benchmark=True→benchmark="official") by @Wauplin in #3734EvalResultEntryby @Wauplin in #3738task_idrequired inEvalResultEntryby @Wauplin in #3718upload_large_folderby @Wauplin in #3698planstring in org info by @Wauplin in #3753mode=parameter support by @Wauplin in #3785HfApi.snapshot_downloadfor dry_run typing by @Wauplin in #3788__init__by @zucchini-nlp in #3818dataclass.repr=Truebefore wrapping by @zucchini-nlp in #3823💔 Breaking Changes
hf jobs psremoves old Go-template--format '{{.id}}'syntax. Use-qfor IDs or--format json | jqfor custom extraction by @davanstrien in #3799hf reposinstead ofhf repo(old command still works but shows deprecation warning) by @Wauplin in #3848hf repo-files deletetohf repo delete-files(old command hidden from help, shows deprecation warning) by @Wauplin in #3821🐛 Bug and typo fixes
HfFileSystem.resolve_path()with special char@by @lhoestq in #3704📖 Documentation
hf_transferreferences in Korean and German translations by @davanstrien in #3804🏗️ Internal
typer-slimtotyperby @svlandeg in #3797shellinghamfrom the required dependencies by @hanouticelina in #3798unused-ignore-commentwarnings intyformypycompatibility by @hanouticelina in #3691unused-type-ignore-commentwarning fromtyby @hanouticelina in #3803file_downloadtests by @hanouticelina in #3815CollectionItemby @hanouticelina in #3831inference_providerinstead ofinferencein tests by @hanouticelina in #3826v1.4.1: [v1.4.1] Fix file corruption when server ignores Range header on download retryCompare Source
Fix file corruption when server ignores Range header on download retry.
Full details in #3778 by @XciD.
Full Changelog: huggingface/huggingface_hub@v1.4.0...v1.4.1
v1.4.0: [v1.4.0] Building the HF CLI for You and your AI AgentsCompare Source
🧠
hf skills addCLI CommandA new
hf skills addcommand installs thehf-cliskill for AI coding assistants (Claude Code, Codex, OpenCode). Your AI Agent now knows how to search the Hub, download models, run Jobs, manage repos, and more.The skill is composed of two files fetched from the
huggingface_hub docs: a CLI guide (SKILL.md) and the full CLI reference (references/cli.md). Files are installed to a central.agents/skills/hf-cli/directory, and relative symlinks are created from agent-specific directories (e.g.,.claude/skills/hf-cli/→../../.agents/skills/hf-cli/). This ensures a single source of truth when installing for multiple agents.hf skills addCLI command by @julien-c in #3741hf skills addinstalls hf-cli skill to central location with symlinks by @hanouticelina in #3755🖥️ Improved CLI Help Output
The CLI help output has been reorganized to be more informative and agent-friendly:
hfCLI help output by @hanouticelina in #3743📊 Evaluation Results Module
The Hub now has a decentralized system for tracking model evaluation results. Benchmark datasets (like MMLU-Pro, HLE, GPQA) host leaderboards, and model repos store evaluation scores in
.eval_results/*.yamlfiles. These results automatically appear on both the model page and the benchmark's leaderboard. See the Evaluation Results documentation for more details.We added helpers in
huggingface_hubto work with this format:EvalResultEntrydataclass representing evaluation scoreseval_result_entries_to_yaml()to serialize entries to YAML formatparse_eval_result_entries()to parse YAML data back intoEvalResultEntryobjects🖥️ Other CLI Improvements
New
hf papers lscommand to list daily papers on the Hub, with support for filtering by date and sorting by trending or publication date.hf papers lsCLI command by @julien-c in #3723New
hf collectionscommands for managing collections from the CLI:hf collectionscommands by @Wauplin in #3767Other CLI-related improvements:
--expandfield by @hanouticelina in #3760📊 Jobs
Multi-GPU training commands are now supported with
torchrunandaccelerate launch:You can also pass local config files alongside your scripts:
New
hf jobs hardwarecommand to list available hardware options:Better filtering with label support and negation:
⚡️ Inference
🔧 QoL Improvements
📖 Documentation
🐛 Bug and typo fixes
🏗️ Internal
Significant community contributions
The following contributors have made significant changes to the library over the last release:
v1.3.7: [v1.3.7] Log 'x-amz-cf-id' on http error if no request idCompare Source
Log 'x-amz-cf-id' on http error (if no request id) (#3759)
Full Changelog: huggingface/huggingface_hub@v1.3.5...v1.3.7
v1.3.5: [v1.3.5] Configurable default timeout for HTTP callsCompare Source
Default timeout is 10s. This is ok in most use cases but can trigger errors in CIs making a lot of requests to the Hub. Solution is to set
HF_HUB_DOWNLOAD_TIMEOUT=60as environment variable in these cases.Full Changelog: huggingface/huggingface_hub@v1.3.4...v1.3.5
v1.3.4: [v1.3.4] FixCommitUrl._endpointdefault to NoneCompare Source
Full Changelog: huggingface/huggingface_hub@v1.3.3...v1.3.4
v1.3.3: [v1.3.3] List Jobs Hardware & Bug FixesCompare Source
⚙️ List Jobs Hardware
You can now list all available hardware options for Hugging Face Jobs, both from the CLI and programmatically.
From the CLI:
Programmatically:
🐛 Bug Fixes
HfFileSystemStreamFilein #3685 by @leq6cresolve_path() with special char @ in #3704 by @lhoestq✨ Various Improvements
num_papersfield to Organization class in #3695 by @cfahlgren1limitparam tolist_papersAPI method in #3697 by @WauplinMAX_FILE_SIZE_GBfrom 50 to 200 GB in #3696 by @davanstrien📚 Documentation
v1.3.2: [v1.3.2] Zai provider support fortext-to-imageand fix custom endpoint not forwardedCompare Source
Full Changelog: huggingface/huggingface_hub@v1.3.1...v1.3.2
v1.3.1: [v1.3.1] Adddimensions&encoding_formatparameters to feature extraction (embeddings) taskCompare Source
dimensions&encoding_formatparameter to InferenceClient for output embedding size #3671 by @mishig25Full Changelog: huggingface/huggingface_hub@v1.3.0...v1.3.1
v1.3.0: [v1.3.0] New CLI Commands for Hub Discovery, Jobs Monitoring and more!Compare Source
🖥️ CLI:
hf models,hf datasets,hf spacesCommandsThe CLI has been reorganized with dedicated commands for Hub discovery, while
hf repostays focused on managing your own repositories.New commands:
This organization mirrors the Python API (
list_models,model_info, etc.), keeps thehf <resource> <action>pattern, and is extensible for future commands likehf papersorhf collections.hf models/hf datasets/hf spacescommands by @hanouticelina in #3669🔧 Transformers CLI Installer
You can now install the
transformersCLI alongside thehuggingface_hubCLI using the standalone installer scripts.Once installed, you can use the
transformersCLI directly:📊 Jobs Monitoring
New
hf jobs statscommand to monitor your running jobs in real-time, similar todocker stats. It displays a live table with CPU, memory, network, and GPU usage.>>> hf jobs stats JOB ID CPU % NUM CPU MEM % MEM USAGE NET I/O GPU UTIL % GPU MEM % GPU MEM USAGE ------------------------ ----- ------- ----- -------------- --------------- ---------- --------- --------------- 6953ff6274100871415c13fd 0% 3.5 0.01% 1.3MB / 15.0GB 0.0bps / 0.0bps 0% 0.0% 0.0B / 22.8GBA new
HfApi.fetch_jobs_metrics()method is also available:Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.