Skip to content

Commit de06acb

Browse files
authored
Update codellama.md (#1474)
Fixing prompt issues for First user query with system prompt and On-going conversation with previous answers.
1 parent a136eaf commit de06acb

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

codellama.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -244,7 +244,7 @@ inputs = tokenizer(prompt, return_tensors="pt", add_special_tokens=False).to("cu
244244
system = "Provide answers in JavaScript"
245245
user = "Write a function that computes the set of sums of all contiguous sublists of a given list."
246246

247-
prompt = f"<s><<SYS>>\\n{system}\\n<</SYS>>\\n\\n{user}"
247+
prompt = f"<s>[INST] <<SYS>>\\n{system}\\n<</SYS>>\\n\\n{user}[/INST]"
248248
inputs = tokenizer(prompt, return_tensors="pt", add_special_tokens=False).to("cuda")
249249
```
250250

@@ -261,7 +261,7 @@ answer_2 = "answer_2"
261261
user_3 = "user_prompt_3"
262262

263263
prompt = f"<<SYS>>\\n{system}\\n<</SYS>>\\n\\n{user_1}"
264-
prompt = f"<s>[INST] {prompt.strip()} [/INST] {answer_1.strip()} </s>"
264+
prompt += f"<s>[INST] {prompt.strip()} [/INST] {answer_1.strip()} </s>"
265265
prompt += f"<s>[INST] {user_2.strip()} [/INST] {answer_2.strip()} </s>"
266266
prompt += f"<s>[INST] {user_3.strip()} [/INST]"
267267

0 commit comments

Comments
 (0)