diff --git a/docs/AI-for-security/llm-performance-matrix.asciidoc b/docs/AI-for-security/llm-performance-matrix.asciidoc index 4eb1a49a6f..5a6268ca8d 100644 --- a/docs/AI-for-security/llm-performance-matrix.asciidoc +++ b/docs/AI-for-security/llm-performance-matrix.asciidoc @@ -11,18 +11,25 @@ Models from third-party LLM providers. [cols="1,1,1,1,1,1,1,1", options="header"] |=== +<<<<<<< HEAD | *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery* | *AI-powered SIEM migration* | *Model* |*Claude 3: Opus* | Excellent | Excellent | Excellent | Good | Great | Good | |*Claude 3.7: Sonnet* | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent +======= +| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery* | *Automatic Migration* +| *Model* |*Claude 3.7: Sonnet* | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent +>>>>>>> ac6ee710 (Update llm-performance-matrix.asciidoc (#6787)) | |*Claude 3.5: Sonnet v2*| Excellent | Excellent | Excellent | Excellent | Great | Excellent | |*Claude 3.5: Sonnet* | Excellent| Excellent | Excellent | Excellent | Excellent | Excellent | |*Claude 3.5: Haiku* | Excellent| Excellent | Excellent | Excellent | Poor | Poor | |*Claude 3: Haiku* | Excellent| Excellent | Excellent | Excellent | Poor |Poor | |*GPT-4o* | Excellent| Excellent | Excellent | Excellent | Great |Great | |*GPT-4o-mini* | Excellent| Great | Great | Great | Poor |Good +| | **GPT-4.1** | Excellent| Excellent | Excellent | Excellent | Excellent | Excellent | |**Gemini 1.5 Pro 002** | Excellent| Excellent | Excellent | Excellent | Excellent | Great | |**Gemini 1.5 Flash 002**|Excellent| Poor | Good | Excellent | Poor | Excellent | |**Gemini 2.0 Flash 001**|Excellent| Excellent | Excellent | Excellent | Excellent | Excellent +| | **Gemini 2.5 Pro** |Excellent| Excellent | Excellent | Excellent | Excellent | Excellent |=== [discrete] @@ -31,9 +38,18 @@ Models you can <>. [cols="1,1,1,1,1,1,1", options="header"] |=== +<<<<<<< HEAD | *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions* | *Assistant - Knowledge retrieval* | *Attack Discovery* | *Model* | *Mistral Nemo* | Good | Good | Great | Good | Poor | | *LLama 3.2* | Good | Poor | Good | Poor | Poor | | *LLama 3.1 405b* | Good | Great | Good | Good| Poor | | *LLama 3.1 70b* | Good | Good | Poor | Poor | Poor +======= +| *Feature* | | *Assistant - General* | *Assistant - {esql} generation* | *Assistant - Alert questions*| *Assistant - Knowledge retrieval*| *Attack Discovery* | *Automatic Migration* +| *Model* | *Mistral Nemo* | Good | Good | Great | Good | Poor | Poor +| | **Mistral-Small-3.1-24B-Instruct-2503** | Excellent | Poor | Excellent | Excellent | Good | N/A +| | *LLama 3.2* | Good | Poor | Good | Poor | Poor | Good +| | *LLama 3.1 405b* | Good | Great | Good | Good | Poor | Poor +| | *LLama 3.1 70b* | Good | Good | Poor | Poor | Poor | Good +>>>>>>> ac6ee710 (Update llm-performance-matrix.asciidoc (#6787)) |=== \ No newline at end of file