Skip to content

Commit 38b967c

Browse files
authored
[Obs AI Assistant] Update Mistral ES|QL rating in the LLM performance matrix (elastic#3631)
Closes elastic/kibana#232547 There was an issue with Mistral Small 3.2 ES|QL generation. This has now been fixed when used with the latest LM studio version. This PR updates the ES|QL generation rating for Mistral Small 3.2 based on the evaluation results obtained after the fix.
1 parent c465005 commit 38b967c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

solutions/observability/llm-performance-matrix.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ Models you can [deploy and manage yourself](/solutions/observability/connect-to-
5151
| Provider | Model | **Alert questions** | **APM questions** | **Contextual insights** | **Documentation retrieval** | **Elasticsearch operations** | **{{esql}} generation** | **Execute connector** | **Knowledge retrieval** |
5252
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
5353
| Meta | **Llama-3.3-70B-Instruct** | Excellent | Good | Great | Excellent | Excellent | Good | Good | Excellent |
54-
| Mistral | **Mistral-Small-3.2-24B-Instruct-2506** | Excellent | Poor | Great | Great | Excellent | Poor | Good | Excellent |
54+
| Mistral | **Mistral-Small-3.2-24B-Instruct-2506** | Excellent | Poor | Great | Great | Excellent | Good | Good | Excellent |
5555
| Alibaba Cloud | **Qwen2.5-72b-Instruct** | Excellent | Good | Great | Excellent | Excellent | Good | Good | Excellent |
5656

5757
::::{note}

0 commit comments

Comments
 (0)