Skip to content

Commit d909f81

Browse files
committed
Consolidated duplicate content related to helpful settings for local models in both guides.
1 parent 8ca24f6 commit d909f81

File tree

2 files changed

+12
-12
lines changed

2 files changed

+12
-12
lines changed

docs/guides/profiles.mdx

Lines changed: 0 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -31,15 +31,3 @@ interpreter.loop = True
3131
There are many settings that can be configured. [See them all
3232
here](/settings/all-settings)
3333
</Tip>
34-
35-
## Helpful settings for local models
36-
37-
Local models benefit from more coercion and guidance. This verbosity of adding extra context to messages can impact the conversational experience of Open Interpreter. The following settings allow templates to be applied to messages to improve the steering of the language model while maintaining the natural flow of conversation.
38-
39-
`interpreter.user_message_template` allows users to have their message wrapped in a template. This can be helpful steering a language model to a desired behaviour without needing the user to add extra context to their message.
40-
41-
`interpreter.always_apply_user_message_template` has all user messages to be wrapped in the template. If False, only the last User message will be wrapped.
42-
43-
`interpreter.code_output_template` wraps the output from the computer after code is run. This can help with nudging the language model to continue working or to explain outputs.
44-
45-
`interpreter.empty_code_output_template` is the message that is sent to the language model if code execution results in no output.

docs/guides/running-locally.mdx

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -49,6 +49,18 @@ interpreter.llm.api_base = "http://localhost:11434"
4949
interpreter.chat("how many files are on my desktop?")
5050
```
5151

52+
## Helpful settings for local models
53+
54+
Local models benefit from more coercion and guidance. This verbosity of adding extra context to messages can impact the conversational experience of Open Interpreter. The following settings allow templates to be applied to messages to improve the steering of the language model while maintaining the natural flow of conversation.
55+
56+
`interpreter.user_message_template` allows users to have their message wrapped in a template. This can be helpful steering a language model to a desired behaviour without needing the user to add extra context to their message.
57+
58+
`interpreter.always_apply_user_message_template` has all user messages to be wrapped in the template. If False, only the last User message will be wrapped.
59+
60+
`interpreter.code_output_template` wraps the output from the computer after code is run. This can help with nudging the language model to continue working or to explain outputs.
61+
62+
`interpreter.empty_code_output_template` is the message that is sent to the language model if code execution results in no output.
63+
5264
<Info>
5365
Other configuration settings are explained in
5466
[Settings](/settings/all-settings).

0 commit comments

Comments
 (0)