Image Attachments Trigger 400 Error with o3-mini in Agents Endpoint

[ogipogi]

What happened?
When attempting to use image attachments with the o3-mini model through the agents endpoint, the system returns a 400 error indicating that image_url functionality is not supported by this model. This prevents any image-based interactions when using o3-mini with agents.

Exception in the LOG:

2025-02-02T14:28:00.818Z debug: [BaseClient] userMessage
{
  messageId: "9645a0f6-7bd3-493f-8fbd-1d9385363fbd",
  parentMessageId: "00000000-0000-0000-0000-000000000000",
  conversationId: "ce771f84-f2c1-49b3-86db-581983f8eac1",
  sender: "User",
  text: "do you see the content",
  isCreatedByUser: true,
  // 1 image_url(s)
  image_urls: [{"type":"image_url","image_url":{"url":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAA44AAAMACAYAAA... [truncated]],
  tokenCount: 9,
}
2025-02-02T14:28:00.820Z debug: [api/server/controllers/agents/client.js] chatCompletion
{
  baseURL: undefined,
  // 1 payload(s)
  payload: [{"role":"user","content":[{"type":"text","text":"do you see the content"},{"type":"image_url","image... [truncated]],
}
2025-02-02T14:28:00.839Z debug: [saveConvo] api/app/clients/BaseClient.js - saveMessageToDatabase #saveConvo
2025-02-02T14:28:01.462Z error: [api/server/controllers/agents/client.js #sendCompletion] Unhandled error type 400 Invalid content type. image_url is only supported by certain models... [truncated]
2025-02-02T14:28:01.463Z error: [handleAbortError] AI response error; aborting request: 400 Invalid content type. image_url is only supported by certain models.
2025-02-02T14:28:01.476Z debug: [AgentController] Request closed

[Eole7]

o3 mini has no vision capabilities

[ogipogi]

ahh, that makes sense now. Thank you!