Skip to content

Commit ac2f42d

Browse files
Merge pull request #605 from dustinwloring1988/doc/removed-ollama-modelfile-section
docs: Removed Ollama Modelfile Section
2 parents 1c809be + bd70b8f commit ac2f42d

File tree

1 file changed

+0
-25
lines changed

1 file changed

+0
-25
lines changed

docs/docs/index.md

Lines changed: 0 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -148,31 +148,6 @@ sudo npm install -g pnpm
148148
pnpm run dev
149149
```
150150

151-
## Super Important Note on Running Ollama Models
152-
153-
Ollama models by default only have 2048 tokens for their context window. Even for large models that can easily handle way more.
154-
This is not a large enough window to handle the Bolt.new/oTToDev prompt! You have to create a version of any model you want
155-
to use where you specify a larger context window. Luckily it's super easy to do that.
156-
157-
All you have to do is:
158-
159-
- Create a file called "Modelfile" (no file extension) anywhere on your computer
160-
- Put in the two lines:
161-
162-
```
163-
FROM [Ollama model ID such as qwen2.5-coder:7b]
164-
PARAMETER num_ctx 32768
165-
```
166-
167-
- Run the command:
168-
169-
```
170-
ollama create -f Modelfile [your new model ID, can be whatever you want (example: qwen2.5-coder-extra-ctx:7b)]
171-
```
172-
173-
Now you have a new Ollama model that isn't heavily limited in the context length like Ollama models are by default for some reason.
174-
You'll see this new model in the list of Ollama models along with all the others you pulled!
175-
176151
## Adding New LLMs:
177152

178153
To make new LLMs available to use in this version of Bolt.new, head on over to `app/utils/constants.ts` and find the constant MODEL_LIST. Each element in this array is an object that has the model ID for the name (get this from the provider's API documentation), a label for the frontend model dropdown, and the provider.

0 commit comments

Comments
 (0)