Azure OpenAI assistants do not work anymore with Azure AI Search #6729
Unanswered
m-bertolino-exc
asked this question in
Troubleshooting
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
What happened?
I have an Azure OpenAI deployment of gpt 4o in sweden central. I created an assistant on this model and I connected azure ai search to it. Everything worked properly until a few days ago, where the problem appeared.
The assistant works correctly if its not prompted an azure ai question, otherwise it returns a blank answer. There is no error in the console or in the logs folder.
I can see that the document was retrieved properly, therefore I assume its not a problem of the ai search itself. I also tried to use the Azure Foundry portal to see if the same error persisted, so I opened the same assistant, connected the azure ai search service and run the same query: it worked.
It also cannot be a problem related to the size of the document, as the same azure ai search index used to be working days ago.
Version Information
v0.7.7-rc1, but the same problem occurred also on commit c4f1da2
Steps to Reproduce
What browsers are you seeing the problem on?
No response
Relevant log output
2025-04-04T15:12:56.056Z debug: [/assistants/chat/] req.body { text: "what is [redacted] management fee?", sender: "User", clientTimestamp: "2025-04-04T17:12:55", isCreatedByUser: true, parentMessageId: "00000000-0000-0000-0000-000000000000", messageId: "9c9b500c-a0ed-4b8f-b81f-3ce01500f932", error: false, generation: "", endpoint: "azureAssistants", model: "[redacted]-gpt-4o", assistant_id: "[redacted]", key: "never", isContinued: false, isTemporary: false, endpointOption.endpoint: "azureAssistants", endpointOption.assistant_id: "[redacted]", modelOptions.model: "[redacted]-gpt-4o", assistant.append_current_datetime: false, assistant.assistant_id: "[redacted]", assistant.conversation_starters: , assistant.createdAt: Mon Mar 31 2025 08:46:13 GMT+0000 (Coordinated Universal Time), assistant.updatedAt: Mon Mar 31 2025 08:46:13 GMT+0000 (Coordinated Universal Time), // 21 openAI(s) modelsConfig.openAI: ["chatgpt-4o-latest","gpt-4o-mini","gpt-4o","gpt-3.5-turbo","gpt-3.5-turbo-0125","gpt-4-turbo","gpt-4-turbo-2024-04-09","gpt-4-0125-preview","gpt-4-turbo-preview","gpt-4-1106-preview","gpt-3.5-turbo-1106","gpt-3.5-turbo-16k-0613","gpt-3.5-turbo-16k","gpt-4","gpt-4-0314","gpt-4-32k-0314","gpt-4-0613","gpt-3.5-turbo-0613","gpt-4-vision-preview","gpt-3.5-turbo-instruct-0914","gpt-3.5-turbo-instruct"], // 21 agent(s) modelsConfig.agents: ["chatgpt-4o-latest","gpt-4o-mini","gpt-4o","gpt-3.5-turbo","gpt-3.5-turbo-0125","gpt-4-turbo","gpt-4-turbo-2024-04-09","gpt-4-0125-preview","gpt-4-turbo-preview","gpt-4-1106-preview","gpt-3.5-turbo-1106","gpt-3.5-turbo-16k-0613","gpt-3.5-turbo-16k","gpt-4","gpt-4-0314","gpt-4-32k-0314","gpt-4-0613","gpt-3.5-turbo-0613","gpt-4-vision-preview","gpt-3.5-turbo-instruct-0914","gpt-3.5-turbo-instruct"], // 2 google(s) modelsConfig.google: ["gemini-1.5-flash-002","gemini-2.0-flash-lite-preview-02-05"], // 14 anthropic(s) modelsConfig.anthropic: ["claude-3-5-haiku-20241022","claude-3-5-sonnet-20241022","claude-3-5-sonnet-20240620","claude-3-5-sonnet-latest","claude-3-opus-20240229","claude-3-sonnet-20240229","claude-3-haiku-20240307","claude-2.1","claude-2","claude-1.2","claude-1","claude-1-100k","claude-instant-1","claude-instant-1-100k"], // 14 gptPlugin(s) modelsConfig.gptPlugins: ["chatgpt-4o-latest","gpt-4o-mini","gpt-4o","gpt-3.5-turbo","gpt-3.5-turbo-0125","gpt-4-turbo","gpt-4-turbo-2024-04-09","gpt-4-0125-preview","gpt-4-turbo-preview","gpt-4-1106-preview","gpt-3.5-turbo-1106","gpt-3.5-turbo-16k","gpt-4","gpt-4-vision-preview"], // 5 azureOpenAI(s) modelsConfig.azureOpenAI: ["exc-gpt-4o","[redacted]-gpt-4o","[redacted]-gpt-4o","[redacted]-gpt-4o","o3-mini"], // 2 chatGPTBrowser(s) modelsConfig.chatGPTBrowser: ["text-davinci-002-render-sha","gpt-4"], // 18 assistant(s) modelsConfig.assistants: ["chatgpt-4o-latest","gpt-4o-mini","gpt-4o","gpt-3.5-turbo","gpt-3.5-turbo-0125","gpt-4-turbo","gpt-4-turbo-2024-04-09","gpt-4-0125-preview","gpt-4-turbo-preview","gpt-4-1106-preview","gpt-3.5-turbo-1106","gpt-3.5-turbo-16k-0613","gpt-3.5-turbo-16k","gpt-4","gpt-4-0314","gpt-4-32k-0314","gpt-4-0613","gpt-3.5-turbo-0613"], // 1 azureAssistant(s) modelsConfig.azureAssistants: ["[redacted]-gpt-4o"], // 27 bedrock(s) modelsConfig.bedrock: ["anthropic.claude-3-5-sonnet-20241022-v2:0","anthropic.claude-3-5-sonnet-20240620-v1:0","anthropic.claude-3-5-haiku-20241022-v1:0","anthropic.claude-3-haiku-20240307-v1:0","anthropic.claude-3-opus-20240229-v1:0","anthropic.claude-3-sonnet-20240229-v1:0","anthropic.claude-v2","anthropic.claude-v2:1","anthropic.claude-instant-v1","cohere.command-r-v1:0","cohere.command-r-plus-v1:0","meta.llama2-13b-chat-v1","meta.llama2-70b-chat-v1","meta.llama3-8b-instruct-v1:0","meta.llama3-70b-instruct-v1:0","meta.llama3-1-8b-instruct-v1:0","meta.llama3-1-70b-instruct-v1:0","meta.llama3-1-405b-instruct-v1:0","mistral.mistral-7b-instruct-v0:2","mistral.mixtral-8x7b-instruct-v0:1","mistral.mistral-large-2402-v1:0","mistral.mistral-large-2407-v1:0","mistral.mistral-small-2402-v1:0","ai21.jamba-instruct-v1:0","amazon.titan-text-lite-v1","amazon.titan-text-express-v1","amazon.titan-text-premier-v1:0"], } 2025-04-04T15:12:56.570Z debug: [saveConvo] api/server/services/Threads/manage.js #saveUserMessage 2025-04-04T15:12:56.832Z debug: [heartbeat 1] run_id: run_O39n55upWAwQgMMs5GQdZlCI | Retrieving run status... 2025-04-04T15:12:57.118Z debug: [heartbeat 1] run_id: run_O39n55upWAwQgMMs5GQdZlCI | Elapsed run retrieval time: 286 2025-04-04T15:12:57.118Z debug: [in_progress] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI 2025-04-04T15:12:57.118Z debug: [heartbeat 1] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI | status: in_progress 2025-04-04T15:13:00.255Z debug: [heartbeat 2] run_id: run_O39n55upWAwQgMMs5GQdZlCI | Retrieving run status... 2025-04-04T15:13:00.557Z debug: [heartbeat 2] run_id: run_O39n55upWAwQgMMs5GQdZlCI | Elapsed run retrieval time: 301 2025-04-04T15:13:00.558Z debug: [requires_action] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI 2025-04-04T15:13:00.558Z debug: [heartbeat 2] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI | status: requires_ac... [truncated] 2025-04-04T15:13:00.558Z debug: [FINAL] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI | status: requires_action 2025-04-04T15:13:00.697Z debug: [runAssistant] Final step for run_O39n55upWAwQgMMs5GQdZlCI with status requires_action { id: "step_TSQbCrmj88QYutRL3yokpja7", object: "thread.run.step", created_at: 1743779577, run_id: "run_O39n55upWAwQgMMs5GQdZlCI", assistant_id: "[redacted]", thread_id: "thread_JyDafhldnj4Rfp01aygyu6Dg", type: "tool_calls", status: "in_progress", cancelled_at: null, completed_at: null, expires_at: 1743780176, failed_at: null, last_error: null, step_details.type: "tool_calls", // 1 tool_call(s) step_details.tool_calls: [{"id":"call_j7jsPeDLLXWleawk7PVs0cgi","type":"function","function":{"name":"[redacted]-ai-search","argum... [truncated]], usage: null, } 2025-04-04T15:13:00.699Z debug: Content data: { index: 0, type: "tool_call", tool_call.id: "call_j7jsPeDLLXWleawk7PVs0cgi", tool_call.type: "function", function.name: "[redacted]-ai-search", function.arguments: "{\"query\":\"[redacted] management fee\"}", function.output: null, tool_call.progress: 0.01, messageId: "33936ff0-4c45-44db-afea-0c0911a54766", thread_id: "thread_JyDafhldnj4Rfp01aygyu6Dg", conversationId: "cc4e6c3b-f331-4ce9-a6a8-e226c46897dc", } 2025-04-04T15:13:00.701Z debug: [required actions] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI ["{\"tool\":\"[redacted]-ai-search\",\"toolInput\":{\"query\":\"[redacted] management fee\"},\"toolCallId\":\"call_j7jsPeDL... [truncated]"] 2025-04-04T15:13:04.184Z debug: Content data: { index: 0, type: "tool_call", function.name: "[redacted]-ai-search", function.arguments: "{\"query\":\"[redacted] management fee\"}", function.output: "[{\"id\":\"bWF4aW1pbGlhbmx1bmQuc2hhcmVwb2ludC5jb20sZjdhN2Q0M2ItMzdlYi00Mjg3LThiMzItOTFkYWEyYjY5MGY5LGU3... [truncated]", tool_call.id: "call_j7jsPeDLLXWleawk7PVs0cgi", tool_call.type: "function", tool_call.progress: 1, tool_call.action: false, messageId: "33936ff0-4c45-44db-afea-0c0911a54766", thread_id: "thread_JyDafhldnj4Rfp01aygyu6Dg", conversationId: "cc4e6c3b-f331-4ce9-a6a8-e226c46897dc", } 2025-04-04T15:13:04.653Z debug: [heartbeat 1] run_id: run_O39n55upWAwQgMMs5GQdZlCI | Retrieving run status... 2025-04-04T15:13:04.972Z debug: [heartbeat 1] run_id: run_O39n55upWAwQgMMs5GQdZlCI | Elapsed run retrieval time: 319 2025-04-04T15:13:04.973Z debug: [in_progress] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI 2025-04-04T15:13:04.973Z debug: [heartbeat 1] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI | status: in_progress 2025-04-04T15:13:05.304Z debug: Content data: { index: 0, type: "tool_call", tool_call.id: "call_j7jsPeDLLXWleawk7PVs0cgi", tool_call.type: "function", function.name: "[redacted]-ai-search", function.arguments: "{\"query\":\"[redacted] management fee\"}", function.output: "[{\"id\":\"bWF4aW1pbGlhbmx1bmQuc2hhcmVwb2ludC5jb20sZjdhN2Q0M2ItMzdlYi00Mjg3LThiMzItOTFkYWEyYjY5MGY5LGU3... [truncated]", tool_call.progress: 1, messageId: "33936ff0-4c45-44db-afea-0c0911a54766", thread_id: "thread_JyDafhldnj4Rfp01aygyu6Dg", conversationId: "cc4e6c3b-f331-4ce9-a6a8-e226c46897dc", } 2025-04-04T15:13:08.314Z debug: [heartbeat 2] run_id: run_O39n55upWAwQgMMs5GQdZlCI | Retrieving run status... 2025-04-04T15:13:08.722Z debug: [heartbeat 2] run_id: run_O39n55upWAwQgMMs5GQdZlCI | Elapsed run retrieval time: 407 2025-04-04T15:13:08.723Z debug: [heartbeat 2] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI | status: in_progress 2025-04-04T15:13:11.845Z debug: [heartbeat 3] run_id: run_O39n55upWAwQgMMs5GQdZlCI | Retrieving run status... 2025-04-04T15:13:12.161Z debug: [heartbeat 3] run_id: run_O39n55upWAwQgMMs5GQdZlCI | Elapsed run retrieval time: 316 2025-04-04T15:13:12.161Z debug: [failed] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI 2025-04-04T15:13:12.161Z debug: [heartbeat 3] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI | status: failed 2025-04-04T15:13:12.162Z debug: [FINAL] user: 67bc7df937303c44f41294a0 | thread_id: thread_JyDafhldnj4Rfp01aygyu6Dg | run_id: run_O39n55upWAwQgMMs5GQdZlCI | status: failed 2025-04-04T15:13:12.299Z debug: [/assistants/chat/] response { run.id: "run_O39n55upWAwQgMMs5GQdZlCI", run.object: "thread.run", run.created_at: 1743779576, run.assistant_id: "[redacted]", run.thread_id: "thread_JyDafhldnj4Rfp01aygyu6Dg", run.status: "failed", run.started_at: 1743779584, run.expires_at: null, run.cancelled_at: null, run.failed_at: 1743779588, run.completed_at: null, run.required_action: null, last_error.code: "rate_limit_exceeded", last_error.message: "Rate limit is exceeded. Try again in 60 seconds.", run.model: "gpt-4o", run.instructions: "", // 1 tool(s) run.tools: [{"type":"function","function":{"name":"[redacted]-ai-search","description":"Use the '[redacted]-ai-search' t... [truncated]], run.tool_resources: [object Object], run.metadata: [object Object], run.temperature: 1, run.top_p: 1, run.max_completion_tokens: null, run.max_prompt_tokens: null, truncation_strategy.type: "auto", truncation_strategy.last_messages: null, run.incomplete_details: null, usage.prompt_tokens: 279, usage.completion_tokens: 20, usage.total_tokens: 299, prompt_token_details.cached_tokens: 0, run.response_format: "auto", run.tool_choice: "auto", run.parallel_tool_calls: true, steps: , } 2025-04-04T15:13:12.315Z debug: [saveConvo] api/server/services/Threads/manage.js #saveAssistantMessage 2025-04-04T15:13:12.366Z debug: [OpenAIClient] chatCompletion { baseURL: "https://[redacted].openai.azure.com/openai/deployments/LC-4o/chat/completions?api-version=2025-01-... [truncated]", modelOptions.model: "[redacted]-gpt-4o", modelOptions.temperature: 0.2, modelOptions.presence_penalty: 0, modelOptions.frequency_penalty: 0, modelOptions.max_tokens: 16, modelOptions.user: undefined, // 1 message(s) modelOptions.messages: [{"role":"system","content":"Please generate a concise, 5-word-or-less title for the conversation, us... [truncated]], } 2025-04-04T15:13:12.367Z debug: [spendTokens] conversationId: cc4e6c3b-f331-4ce9-a6a8-e226c46897dc | Context: message | Token usage: { promptTokens: 279, completionTokens: 20, } 2025-04-04T15:13:12.368Z debug: Making request to https://[redacted].openai.azure.com/openai/deployments/LC-4o/chat/completions?api-version=2025-01-01-preview 2025-04-04T15:13:12.372Z debug: [spendTokens] No transactions incurred against balance 2025-04-04T15:13:12.891Z debug: [OpenAIClient] chatCompletion response { // 1 choice(s) choices: [{"content_filter_results":{"hate":{"filtered":false,"severity":"safe"},"protected_material_code":{"f... [truncated]], created: 1743779592, id: "chatcmpl-BId1EQJNGcnOLZ2sTAJwg6hk7BBz9", model: "gpt-4o-2024-05-13", object: "chat.completion", // 1 prompt_filter_result(s) prompt_filter_results: [{"prompt_index":0,"content_filter_results":{}}], system_fingerprint: "fp_ee1d74bde0", usage.completion_tokens: 5, completion_tokens_details.accepted_prediction_tokens: 0, completion_tokens_details.audio_tokens: 0, completion_tokens_details.reasoning_tokens: 0, completion_tokens_details.rejected_prediction_tokens: 0, usage.prompt_tokens: 74, prompt_tokens_details.audio_tokens: 0, prompt_tokens_details.cached_tokens: 0, usage.total_tokens: 79, } 2025-04-04T15:13:12.894Z debug: [spendTokens] conversationId: cc4e6c3b-f331-4ce9-a6a8-e226c46897dc | Context: title | Token usage: { promptTokens: 71, completionTokens: 4, } 2025-04-04T15:13:12.897Z debug: [OpenAIClient] Convo Title: [redacted] Management Fee 2025-04-04T15:13:12.897Z debug: [saveConvo] api/server/services/Endpoints/assistants/addTitle.js 2025-04-04T15:13:12.908Z debug: [spendTokens] No transactions incurred against balanceScreenshots
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions