[BUG] Unable to use minimax-M2 on OpenAI Compatible API #8998
Description
Problem (one or two sentences)
unable to use minimax-M2 on nvidia api
Context (who is affected and when)
unable to use roo code so
Reproduction steps
get api key on nvidia , try to use model, getting error about body
Expected result
Should work fine
Actual result
Error body
Variations tried (optional)
from openai import OpenAI
client = OpenAI(
base_url = "https://integrate.api.nvidia.com/v1",
api_key = "$API_KEY_REQUIRED_IF_EXECUTING_OUTSIDE_NGC"
)
completion = client.chat.completions.create(
model="minimaxai/minimax-m2",
messages=[{"role":"user","content":""}],
temperature=1,
top_p=0.95,
max_tokens=8192,
stream=True
)
for chunk in completion:
if chunk.choices[0].delta.content is not None:
print(chunk.choices[0].delta.content, end="")
App Version
latest
API Provider (optional)
OpenAI Compatible
Model Used (optional)
minimaxai/minimax-m2
Roo Code Task Links (optional)
No response