Skip to content

Commit 132d7a6

Browse files
committed
updates LLM matrix
1 parent eb1c531 commit 132d7a6

File tree

1 file changed

+12
-11
lines changed

1 file changed

+12
-11
lines changed

solutions/security/ai/large-language-model-performance-matrix.md

Lines changed: 12 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -22,17 +22,18 @@ This page describes the performance of various large language models (LLMs) for
2222

2323
Models from third-party LLM providers.
2424

25-
| **Feature** | | **Assistant - General** | **Assistant - {{esql}} generation** | **Assistant - Alert questions** | **Assistant - Knowledge retrieval** | **Attack Discovery** |
26-
| --- | --- | --- | --- | --- | --- | --- |
27-
| **Model** | **Claude 3: Opus** | Excellent | Excellent | Excellent | Good | Great |
28-
| | **Claude 3.5: Sonnet v2** | Excellent | Excellent | Excellent | Excellent | Great |
29-
| | **Claude 3.5: Sonnet** | Excellent | Excellent | Excellent | Excellent | Excellent |
30-
| | **Claude 3.5: Haiku** | Excellent | Excellent | Excellent | Excellent | Poor |
31-
| | **Claude 3: Haiku** | Excellent | Excellent | Excellent | Excellent | Poor |
32-
| | **GPT-4o** | Excellent | Excellent | Excellent | Excellent | Great |
33-
| | **GPT-4o-mini** | Excellent | Great | Great | Great | Poor |
34-
| | **Gemini 1.5 Pro 002** | Excellent | Excellent | Excellent | Excellent | Excellent |
35-
| | **Gemini 1.5 Flash 002** | Excellent | Poor | Good | Excellent | Poor |
25+
| **Feature** | | **Assistant - General** | **Assistant - {{esql}} generation** | **Assistant - Alert questions** | **Assistant - Knowledge retrieval** | **Attack Discovery** | **AI-powered SIEM migration** |
26+
| --- | --- | --- | --- | --- | --- | --- | --- |
27+
| **Model** | **Claude 3: Opus** | Excellent | Excellent | Excellent | Good | Great | Good
28+
| | **Claude 3.7: Sonnet** | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent
29+
| | **Claude 3.5: Sonnet v2** | Excellent | Excellent | Excellent | Excellent | Great | Excellent
30+
| | **Claude 3.5: Sonnet** | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent
31+
| | **Claude 3.5: Haiku** | Excellent | Excellent | Excellent | Excellent | Poor | Poor
32+
| | **Claude 3: Haiku** | Excellent | Excellent | Excellent | Excellent | Poor | Poor
33+
| | **GPT-4o** | Excellent | Excellent | Excellent | Excellent | Great | Great
34+
| | **GPT-4o-mini** | Excellent | Great | Great | Great | Poor | Good
35+
| | **Gemini 1.5 Pro 002** | Excellent | Excellent | Excellent | Excellent | Excellent | Great
36+
| | **Gemini 1.5 Flash 002** | Excellent | Poor | Good | Excellent | Poor | Excellent
3637

3738

3839
## Open-source models [_open_source_models]

0 commit comments

Comments
 (0)