Is it intentional that "role: system" part of API request is not at position 0 of the json object? #5139
Replies: 3 comments 2 replies
-
|
Yes it’s intentional. Since a lot of custom endpoints don’t seem to support this, I’ll change this or at least make it an option to place at index 0 instead of length - 2. |
Beta Was this translation helpful? Give feedback.
-
|
What's the benefit? |
Beta Was this translation helpful? Give feedback.
-
|
I now ran into it models that just ignore everything before system prompt at (length - 2), where is the code that do this/how can I change it? On latest pre-built docker image. |
Beta Was this translation helpful? Give feedback.
-
|
I'll add an option within the week. thanks! |
Beta Was this translation helpful? Give feedback.
-
Has this option been added? |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
What happened?
Some API provider will just add the system prompt as a second one instead of replacing the default one defined in Jinja2.
Steps to Reproduce
Seems long prompt will put the system prompt at second last instead of first? Not 100% reproducible.
What browsers are you seeing the problem on?
No response
Relevant log output
No response
Screenshots
No response
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions