GPT-OSS Thinking Tags Don't Close #194
Description
Describe the bug
I am noticing GPT-OSS, both the 20b and 120b models are missing the closing tag. This is because of Open AI's Harmony formatting for thinking.
I have seen other AI hosting like vLLM and SGLang have updates to fix that parsing. I use open webui as my frontend and this makes GPT-OSS basically impossible to use and I imagine is actively deterring (at least a certian percentage) of customers from using AWS Bedrock or the gateway entirely.
Please complete the following information:
- Which API you used: [/chat/completions]
- Which model you used: [gpt-oss-120b]
To Reproduce
Should be easily reproducible whenever making a request to gpt-oss-120b or gpt-oss-20b through bedrock. Look for ...LLM output and no before it gives it's response intended for the user.
Expected behavior
I expect aws bedrock gateway to keep the correct tags instead of stripping them.
Screenshots
If applicable, add screenshots to help explain your problem (please DO NOT include sensitive information).
Additional context
I am 90% sure this is a BAG problem and not an Open WebUI problem because when I output just the plain text I don't see that closing tag. Thanks so much for looking into this!