chat: Change role to user for user prompts (#1447)

vladoovtcharov · Jack-Khuu · web-flow · commit fb65b8bbc405 · 2025-01-22T12:37:28.000-08:00
Co-authored-by: Jack-Khuu &lt;jack.khuu.7@gmail.com&gt;
diff --git a/torchchat/generate.py b/torchchat/generate.py
@@ -1126,7 +1126,7 @@ def chat(
                     messages_to_encode.append(
                         {"role": "system", "content": self.system_prompt}
                     )
-                messages_to_encode.append({"role": "system", "content": prompt})
+                messages_to_encode.append({"role": "user", "content": prompt})
                 encoded = self.chat_formatter.encode_dialog_prompt(
                     messages_to_encode, add_generation_prompt=True,
                 )

Original file line number	Diff line number	Diff line change
`@@ -1126,7 +1126,7 @@ def chat(`
`1126`	`1126`	`messages_to_encode.append(`
`1127`	`1127`	`{"role": "system", "content": self.system_prompt}`
`1128`	`1128`	`)`
`1129`		`- messages_to_encode.append({"role": "system", "content": prompt})`
	`1129`	`+ messages_to_encode.append({"role": "user", "content": prompt})`
`1130`	`1130`	`encoded = self.chat_formatter.encode_dialog_prompt(`
`1131`	`1131`	`messages_to_encode, add_generation_prompt=True,`
`1132`	`1132`	`)`