You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/customize/deep-dives/autocomplete.mdx
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,6 +5,10 @@ keywords: [autocomplete]
5
5
sidebarTitle: Autocomplete
6
6
---
7
7
8
+
<Info>
9
+
For a comprehensive comparison of all autocomplete models, see our [model recommendations table](/customization/models#recommended-models).
10
+
</Info>
11
+
8
12
## How to Set Up Autocomplete in Continue with Codestral (Recommended)
9
13
10
14
If you want to have the best autocomplete experience, we recommend using Codestral, which is available through the [Mistral API](https://console.mistral.ai/). To do this, obtain an API key and add it to your config:
Copy file name to clipboardExpand all lines: docs/customize/model-roles/00-intro.mdx
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -17,6 +17,10 @@ Models in Continue can be configured to be used for various roles in the extensi
17
17
18
18
These roles can be specified for a `config.yaml` model block using `roles`. See the [YAML Specification](/reference#models) for more details.
19
19
20
+
<Info>
21
+
For recommendations on which models work best for each role, see our [comprehensive model recommendations](/customization/models#recommended-models).
22
+
</Info>
23
+
20
24
## Selecting model roles
21
25
22
26
You can control which of the models in your assistant for a given role will be currently used for that role. Above the main input, click the 3 dots and then the cube icon to expand the `Models` section. Then you can use the dropdowns to select an active model for each role.
Copy file name to clipboardExpand all lines: docs/customize/model-roles/apply.mdx
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,6 +9,10 @@ When editing code, Chat and Edit model output often doesn't clearly align with e
9
9
10
10
## Recommended Apply models
11
11
12
+
<Info>
13
+
For the latest Apply model recommendations, see our [comprehensive model recommendations](/customization/models#recommended-models).
14
+
</Info>
15
+
12
16
We recommend [Morph Fast Apply](https://morphllm.com) or [Relace's Instant Apply model](https://hub.continue.dev/relace/instant-apply) for the fastest Apply experience. You can sign up for Morph's free tier [here](https://morphllm.com/dashboard) or get a Relace API key [here](https://app.relace.ai/settings/api-keys).
13
17
14
18
However, most Chat models can also be used for applying code changes. We recommend smaller/cheaper models for the task, such as Claude 3.5 Haiku.
Copy file name to clipboardExpand all lines: docs/customize/model-roles/autocomplete.mdx
+5-1Lines changed: 5 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,7 +12,11 @@ In Continue, autocomplete models are used to display inline [Autocomplete](../..
12
12
13
13
## Recommended Autocomplete models
14
14
15
-
Visit the [Autocomplete Deep Dive](../deep-dives/autocomplete) for recommended models and more details.
15
+
<Info>
16
+
See our [comprehensive model recommendations](/customization/models#recommended-models) for the best autocomplete models, including both open and closed options.
17
+
</Info>
18
+
19
+
Visit the [Autocomplete Deep Dive](../deep-dives/autocomplete) for detailed setup instructions and configuration options.
Copy file name to clipboardExpand all lines: docs/customize/model-roles/chat.mdx
+11-7Lines changed: 11 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,24 +11,28 @@ In Continue, these models are used for normal [Chat](../../features/chat/quick-s
11
11
12
12
## Recommended Chat models
13
13
14
+
<Info>
15
+
For the latest and most comprehensive model recommendations, see our [model recommendations table](/customization/models#recommended-models).
16
+
</Info>
17
+
14
18
## Best overall experience
15
19
16
20
For the best overall Chat experience, you will want to use a 400B+ parameter model or one of the frontier models.
17
21
18
-
### Claude Sonnet 3.7 from Anthropic
22
+
### Claude Opus 4.1 and Claude Sonnet 4 from Anthropic
19
23
20
-
Our current top recommendation is Claude 3.7 Sonnet from [Anthropic](../model-providers/top-level/anthropic).
24
+
Our current top recommendations are Claude Opus 4.1 and Claude Sonnet 4 from [Anthropic](../model-providers/top-level/anthropic).
21
25
22
26
<Tabs>
23
27
<Tabtitle="Hub">
24
-
View the [Claude 3.7 Sonnet model block](https://hub.continue.dev/anthropic/claude-3-7-sonnet) on the hub.
28
+
View the [Claude Opus 4.1 model block](https://hub.continue.dev/anthropic/claude-4-1-opus) or [Claude Sonnet 4 model block](https://hub.continue.dev/anthropic/claude-4-sonnet) on the hub.
25
29
</Tab>
26
30
<Tabtitle="YAML">
27
31
```yaml title="config.yaml"
28
32
models:
29
-
- name: Claude 3.7 Sonnet
33
+
- name: Claude Opus 4.1
30
34
provider: anthropic
31
-
model: claude-3-7-sonnet-latest
35
+
model: claude-4-1-opus
32
36
apiKey: <YOUR_ANTHROPIC_API_KEY>
33
37
```
34
38
</Tab>
@@ -37,9 +41,9 @@ Our current top recommendation is Claude 3.7 Sonnet from [Anthropic](../model-pr
Copy file name to clipboardExpand all lines: docs/customize/model-roles/edit.mdx
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -44,6 +44,10 @@ In Continue, you can add `edit` to a model's roles to specify that it can be use
44
44
45
45
Explore edit models in [the hub](https://hub.continue.dev/explore/models?roles=edit). Generally, our recommendations for Edit overlap with recommendations for Chat.
46
46
47
+
<Info>
48
+
See our [comprehensive model recommendations](/customization/models#recommended-models) for the best models for Edit and Chat roles.
49
+
</Info>
50
+
47
51
## Prompt templating
48
52
49
53
You can customize the prompt template used for editing code by setting the `promptTemplates.edit` property in your model configuration. Continue uses [Handlebars syntax](https://handlebarsjs.com/guide/) for templating.
Copy file name to clipboardExpand all lines: docs/customize/model-roles/embeddings.mdx
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -19,6 +19,10 @@ You can add `embed` to a model's `roles` to specify that it can be used to embed
19
19
20
20
## Recommended embedding models
21
21
22
+
<Info>
23
+
See our [comprehensive model recommendations](/customization/models#recommended-models) for the best embedding models comparison.
24
+
</Info>
25
+
22
26
If you have the ability to use any model, we recommend `voyage-code-3`, which is listed below along with the rest of the options for embeddings models.
23
27
24
28
If you want to generate embeddings locally, we recommend using `nomic-embed-text` with [Ollama](../model-providers/top-level/ollama#embeddings-model).
Copy file name to clipboardExpand all lines: docs/customize/model-roles/reranking.mdx
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,6 +11,10 @@ In Continue, rerankers are designated using the `rerank` role and used by [@Code
11
11
12
12
## Recommended reranking models
13
13
14
+
<Info>
15
+
For a comparison of all reranking models including open and closed options, see our [comprehensive model recommendations](/customization/models#recommended-models).
16
+
</Info>
17
+
14
18
If you have the ability to use any model, we recommend `rerank-2` by Voyage AI, which is listed below along with the rest of the options for rerankers.
Copy file name to clipboardExpand all lines: docs/features/agent/model-setup.mdx
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,6 +6,10 @@ sidebarTitle: "Model Setup"
6
6
7
7
The models you set up for Chat mode will be used with Agent mode if the model supports tool calling. The recommended models and how to set them up can be found [here](/features/chat/model-setup).
8
8
9
+
<Info>
10
+
For the latest recommendations on the best models for Agent/Plan mode, see our [comprehensive model recommendations](/customization/models#recommended-models).
0 commit comments