docs: update Ollama setup instructions and add troubleshooting section#337
docs: update Ollama setup instructions and add troubleshooting section#337hannesrudolph merged 1 commit intomainfrom
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
There was a problem hiding this comment.
Pull Request Overview
This PR updates the Ollama setup documentation to improve user experience with better setup instructions and troubleshooting guidance. The changes clarify how Roo handles context windows automatically and provide comprehensive help for common issues.
- Simplified context window configuration instructions to reflect automatic handling
- Updated setup steps to include API key configuration and clarify model naming
- Added comprehensive troubleshooting section for out-of-memory issues
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
| **Fixes** | ||
| 1. **Preload the model** | ||
| ```bash | ||
| ollama run <model-name> |
There was a problem hiding this comment.
HTML entities < should be < in the bash code block. This appears to be an encoding issue.
| 2. **Pin the context window (`num_ctx`)** | ||
| - Option A — interactive session, then save: | ||
| ```bash | ||
| # inside `ollama run <base-model>` |
There was a problem hiding this comment.
HTML entities < and > should be < and > respectively in the bash code blocks.
| ```bash | ||
| # inside `ollama run <base-model>` | ||
| /set parameter num_ctx 32768 | ||
| /save <your_model_name> |
There was a problem hiding this comment.
HTML entities < and > should be < and > respectively in the bash code blocks.
| ``` | ||
| Then re-create the model: | ||
| ```bash | ||
| ollama create <your_model_name> -f Modelfile |
There was a problem hiding this comment.
HTML entities < and > should be < and > respectively in the bash code block.
| 5. **Restart after an OOM** | ||
| ```bash | ||
| ollama ps | ||
| ollama stop <model-name> |
There was a problem hiding this comment.
HTML entities < and > should be < and > respectively in the bash code block.
1 participant
Important
Update Ollama setup instructions and add troubleshooting for out-of-memory errors in
docs/providers/ollama.md.docs/providers/ollama.mdto clarify model configuration, specifically context window settings.This description was created by
for 44e1efc. You can customize this summary. It will automatically update as commits are pushed.