🚀 Add InferencePort AI to Local Apps#1997
Open
sharktide wants to merge 3 commits intohuggingface:mainfrom
Open
🚀 Add InferencePort AI to Local Apps#1997sharktide wants to merge 3 commits intohuggingface:mainfrom
sharktide wants to merge 3 commits intohuggingface:mainfrom
Conversation
sharktide
requested review from
SBrandeis,
Wauplin,
gary149,
julien-c,
ngxson and
pcuenca
as code owners
Author
|
@julien-c sorry to bother, but any ETA on this? |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
App Summary
InferencePort AI is a desktop application designed to make it easy to run, test, and share AI models locally on your computer. It essentially gives you a user-friendly hub for working with machine learning models — especially those from open-source repositories and Hugging Face Spaces — without needing to handle complex command-line setups or cloud infrastructure.
Here’s what InferencePort AI does:
⚡ Run local models: Launch and interact with AI models hosted on your own machine, using your CPU or GPU.
🌐 Browse and preview community AI demos: Explore and preview Hugging Face Spaces or other community model demos within the app.
💻 Cross-platform: Works on Windows, macOS, and Linux with an easy interface.
🔐 Security-focused and open source: Built to be transparent, modifiable, and community-driven.
This app summary was written by a model running in our app :)
Hugging Face Integration
Starting in v2.0.1, we have launched a new integration that allows people to run GGUF models from the Hub through the regular app interface via a simple deeplink. eg
inferenceport-ai:///marketplace?hf=unsloth/Kimi-K2.5-GGUF
This opens a friendly quantization select modal with a simple download button. Then, the user can run the selected GGUF model on their own hardware through our chat interface.
Logo: https://github.com/sharktide/inferenceport-ai/blob/main/src/build/icon.png
Banner Logo: https://github.com/sharktide/inferenceport-ai/blob/main/src/build/banner.png
Homepage: https://inference.js.org