Bedrock promptPrefix in modelSpec (librechat.yml) #7946
-
What happened?Describe the bug Expected behavior Proposed fix (optional) Version Informationubuntu@i-0fc80bc0f43aea0b1:/LibreChat/LibreChat$ docker images | grep librechat Steps to ReproduceSteps to reproduce the behavior: Define a bedrock model in modelSpecs with a promptPrefix in the preset Start a new chat session with that model Observe that the prefix is not applied (check system messages, behavior, or logs) What browsers are you seeing the problem on?Chrome Relevant log outputI don't see any relevant logs ScreenshotsCode of Conduct
|
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
You won't see it in the UI, but it still works: modelSpecs:
enforce: false
prioritize: true
addedEndpoints: ["agents"]
list:
- name: "Bedrock Sonnet 4"
label: "Bedrock Sonnet 4"
iconURL: "bedrock"
description: "Smart, Efficient Conversational AI"
default: false
preset:
endpoint: "bedrock"
model: "us.anthropic.claude-sonnet-4-20250514-v1:0" # actual model label
modelLabel: "Bedrock Sonnet 4"
promptPrefix: "End every message with [END]" |
Beta Was this translation helpful? Give feedback.
You won't see it in the UI, but it still works: