Skip to content

Commit e65b839

Browse files
committed
docs: improve examples
1 parent 854d902 commit e65b839

File tree

2 files changed

+7
-2
lines changed

2 files changed

+7
-2
lines changed

docs/guide/external-chat-state.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,9 @@ const llamaChat = new LlamaChat({
3838
contextSequence: context.getSequence()
3939
});
4040

41-
let chatHistory = llamaChat.chatWrapper.generateInitialChatHistory();
41+
let chatHistory = llamaChat.chatWrapper.generateInitialChatHistory({
42+
// systemPrompt: "You're a helpful assistant"
43+
});
4244

4345
const prompt = "Hi there, how are you?";
4446

docs/guide/token-prediction.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -119,7 +119,10 @@ const contextSequence = context.getSequence({
119119
tokenPredictor: new DraftSequenceTokenPredictor(draftContextSequence, {
120120
// try to change this value to `1` or more
121121
// and see the difference in response times
122-
minTokens: 0
122+
minTokens: 0,
123+
124+
// the minimum probability of a toke prediction to be considered
125+
minConfidence: 0.6
123126
})
124127
});
125128

0 commit comments

Comments
 (0)