Skip to content

Commit fdd2361

Browse files
738 llm matrix (#6690) (#6698)
* updates LLM performance matrix * update * fixes table format * fix * updates LLM support matrix * fixes table * fixes table (cherry picked from commit 34eff20) Co-authored-by: Benjamin Ironside Goldstein <[email protected]>
1 parent 2298290 commit fdd2361

File tree

1 file changed

+7
-7
lines changed

1 file changed

+7
-7
lines changed

docs/AI-for-security/llm-performance-matrix.asciidoc

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ Models from third-party LLM providers.
1111

1212
[cols="1,1,1,1,1,1,1,1", options="header"]
1313
|===
14-
| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery* | *AI-powered SIEM migration*
14+
| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery* | *Automatic Migration*
1515
| *Model* |*Claude 3: Opus* | Excellent | Excellent | Excellent | Good | Great | Good
1616
| |*Claude 3.7: Sonnet* | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent
1717
| |*Claude 3.5: Sonnet v2*| Excellent | Excellent | Excellent | Excellent | Great | Excellent
@@ -29,11 +29,11 @@ Models from third-party LLM providers.
2929
== Open-source models
3030
Models you can <<connect-to-byo-llm, deploy yourself>>.
3131

32-
[cols="1,1,1,1,1,1,1", options="header"]
32+
[cols="1,1,1,1,1,1,1,1", options="header"]
3333
|===
34-
| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery*
35-
| *Model* | *Mistral Nemo* | Good | Good | Great | Good | Poor
36-
| | *LLama 3.2* | Good | Poor | Good | Poor | Poor
37-
| | *LLama 3.1 405b* | Good | Great | Good | Good| Poor
38-
| | *LLama 3.1 70b* | Good | Good | Poor | Poor | Poor
34+
| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions*| *Assistant - Knowledge retrieval*| *Attack Discovery* | *Automatic Migration*
35+
| *Model* | *Mistral Nemo* | Good | Good | Great | Good | Poor | Poor
36+
| | *LLama 3.2* | Good | Poor | Good | Poor | Poor | Good
37+
| | *LLama 3.1 405b* | Good | Great | Good | Good | Poor | Poor
38+
| | *LLama 3.1 70b* | Good | Good | Poor | Poor | Poor | Good
3939
|===

0 commit comments

Comments
 (0)