@@ -22,17 +22,18 @@ This page describes the performance of various large language models (LLMs) for
2222
2323Models from third-party LLM providers.
2424
25- | ** Feature** | | ** Assistant - General** | ** Assistant - {{esql}} generation** | ** Assistant - Alert questions** | ** Assistant - Knowledge retrieval** | ** Attack Discovery** |
26- | --- | --- | --- | --- | --- | --- | --- |
27- | ** Model** | ** Claude 3: Opus** | Excellent | Excellent | Excellent | Good | Great |
28- | | ** Claude 3.5: Sonnet v2** | Excellent | Excellent | Excellent | Excellent | Great |
29- | | ** Claude 3.5: Sonnet** | Excellent | Excellent | Excellent | Excellent | Excellent |
30- | | ** Claude 3.5: Haiku** | Excellent | Excellent | Excellent | Excellent | Poor |
31- | | ** Claude 3: Haiku** | Excellent | Excellent | Excellent | Excellent | Poor |
32- | | ** GPT-4o** | Excellent | Excellent | Excellent | Excellent | Great |
33- | | ** GPT-4o-mini** | Excellent | Great | Great | Great | Poor |
34- | | ** Gemini 1.5 Pro 002** | Excellent | Excellent | Excellent | Excellent | Excellent |
35- | | ** Gemini 1.5 Flash 002** | Excellent | Poor | Good | Excellent | Poor |
25+ | ** Feature** | | ** Assistant - General** | ** Assistant - {{esql}} generation** | ** Assistant - Alert questions** | ** Assistant - Knowledge retrieval** | ** Attack Discovery** | ** AI-powered SIEM migration** |
26+ | --- | --- | --- | --- | --- | --- | --- | --- |
27+ | ** Model** | ** Claude 3: Opus** | Excellent | Excellent | Excellent | Good | Great | Good
28+ | | ** Claude 3.7: Sonnet** | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent
29+ | | ** Claude 3.5: Sonnet v2** | Excellent | Excellent | Excellent | Excellent | Great | Excellent
30+ | | ** Claude 3.5: Sonnet** | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent
31+ | | ** Claude 3.5: Haiku** | Excellent | Excellent | Excellent | Excellent | Poor | Poor
32+ | | ** Claude 3: Haiku** | Excellent | Excellent | Excellent | Excellent | Poor | Poor
33+ | | ** GPT-4o** | Excellent | Excellent | Excellent | Excellent | Great | Great
34+ | | ** GPT-4o-mini** | Excellent | Great | Great | Great | Poor | Good
35+ | | ** Gemini 1.5 Pro 002** | Excellent | Excellent | Excellent | Excellent | Excellent | Great
36+ | | ** Gemini 1.5 Flash 002** | Excellent | Poor | Good | Excellent | Poor | Excellent
3637
3738
3839## Open-source models [ _ open_source_models]
0 commit comments