Skip to content

Conversation

ilopezluna
Copy link
Contributor

Adds support to run models in GGUF format via Docker Model Runner

Copy link
Member

@julien-c julien-c left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice!

@julien-c julien-c linked an issue Jun 25, 2025 that may be closed by this pull request
Copy link
Member

@Vaibhavs10 Vaibhavs10 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM thanks a lot for the PR @ilopezluna 🔥

This needs an internal PR on our side, I'll deck it up!

@Vaibhavs10 Vaibhavs10 merged commit 48ec3b4 into huggingface:main Jul 1, 2025
3 of 4 checks passed
@Vaibhavs10
Copy link
Member

Thanks a lot @ilopezluna for the PR, it should be live shortly!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature Request] Add Docker Model Runner as a Local App

3 participants