Skip to content

Commit f4eda33

Browse files
committed
docs improvements
1 parent c1de38d commit f4eda33

File tree

3 files changed

+23
-5
lines changed

3 files changed

+23
-5
lines changed

docs/docs/setup/configuration.md

Lines changed: 20 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -199,8 +199,8 @@ Similarly if your model requires a Certificate for authentication, you may use t
199199
"model": "llama2-7b",
200200
"requestOptions": {
201201
"clientCertificate": {
202-
"cert": "C:\temp\ollama.pem",
203-
"key": "C:\temp\ollama.key",
202+
"cert": "C:\tempollama.pem",
203+
"key": "C:\tempollama.key",
204204
"passphrase": "c0nt!nu3"
205205
}
206206
}
@@ -209,6 +209,24 @@ Similarly if your model requires a Certificate for authentication, you may use t
209209
}
210210
```
211211

212+
## Context Length
213+
214+
Continue by default knows the context length for common models. For example, it will automatically assume 200k tokens for Claude 3. For Ollama, the context length is determined automatically by asking Ollama. If neither of these are sufficient, you can manually specify the context length by using hte `"contextLength"` property in your model in config.json.
215+
216+
```json title="~/.continue/config.json"
217+
{
218+
"models": [
219+
{
220+
"title": "My Custom Model",
221+
"provider": "openai",
222+
"model": "my-model",
223+
"contextLength": 8192,
224+
"apiBase": "http://localhost:8000/v1"
225+
}
226+
]
227+
}
228+
```
229+
212230
## Customizing the Chat Template
213231

214232
Most open-source models expect a specific chat format, for example llama2 and codellama expect the input to look like `"[INST] How do I write bubble sort in Rust? [/INST]"`. Continue will automatically attempt to detect the correct prompt format based on the `model`value that you provide, but if you are receiving nonsense responses, you can use the `template` property to explicitly set the format that you expect. The options are: `["llama2", "alpaca", "zephyr", "phind", "anthropic", "chatml", "openchat", "neural-chat", "none"]`.

docs/docs/walkthroughs/codebase-embeddings.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,7 @@ Continue offers a free trial of Voyage AI's reranking model.
294294
}
295295
```
296296

297-
## Customizing which files are indexed
297+
## Ignore files during indexing
298298

299299
Continue respects `.gitignore` files in order to determine which files should not be indexed. If you'd like to exclude additional files, you can add them to a `.continueignore` file, which follows the exact same rules as `.gitignore`.
300300

extensions/vscode/package-lock.json

Lines changed: 2 additions & 2 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)