Skip to content

Commit 6531d94

Browse files
burtenshawpcuenca
andcommitted
respond to feedback
Co-authored-by: Pedro Cuenca <[email protected]>
1 parent bb01c7e commit 6531d94

File tree

1 file changed

+7
-5
lines changed

1 file changed

+7
-5
lines changed

docs/hub/local-apps.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -33,19 +33,21 @@ The best way to check if a local app is supported is to go to the Local Apps set
3333

3434
<Tip>
3535

36-
To use these local apps, copy the snippets from the model card as above.
36+
👨‍💻 To use these local apps, copy the snippets from the model card as above.
37+
38+
👷 If you're building a local app, you can learn about integrating with the Hub in [this guide](https://huggingface.co/docs/hub/en/models-adding-libraries).
3739

3840
</Tip>
3941

4042
### Llama.cpp
4143

42-
Llama.cpp is a high-performance C/C++ library for running LLMs locally with optimized inference across different hardware. If you are running a CPU, this is the best option.
44+
Llama.cpp is a high-performance C/C++ library for running LLMs locally with optimized inference across lots of different hardware, including CPUs, CUDA and Metal.
4345

4446
**Advantages:**
45-
- Extremely fast performance for CPU-based models
47+
- Extremely fast performance for CPU-based models on multiple CPU families
4648
- Low resource usage
4749
- Multiple interface options (CLI, server, Python library)
48-
- Hardware-optimized for CPU and GPU
50+
- Hardware-optimized for CPUs and GPUs
4951

5052
To use Llama.cpp, navigate to the model card and click "Use this model" and copy the command.
5153

@@ -71,10 +73,10 @@ Navigate to the model card and click "Use this model". LM Studio will open and y
7173
Jan is an open-source ChatGPT alternative that runs entirely offline with a user-friendly interface.
7274

7375
**Advantages:**
74-
- Complete privacy (all data stays local)
7576
- User-friendly GUI
7677
- Chat with documents and files
7778
- OpenAI-compatible API server
79+
- OpenAI-compatible API server, so you can run models and use them from other apps
7880

7981
To use Jan, navigate to the model card and click "Use this model". Jan will open and you can start chatting through the interface.
8082

0 commit comments

Comments
 (0)