Skip to main content

Model Security Scorecards

Attack success rate analysis across scanned models

Reset

Models Scanned

23

Avg Attack Success Rate (ASR)

18.76%

Total Scans

468

63.7%
Meta logo Meta

meta-llama-4-scout

Critical Risk
Scans 26
Reports 333
Probes 452,790
Last Scan 2 months ago
Vulns 402
Risk Score 49.57%
54.4%
Meta logo Meta

meta-llama-3-3

Retired
Critical Risk
Scans 26
Reports 329
Probes 454,678
Last Scan 2 months ago
Vulns 333
Risk Score 41.06%
39.6%
OpenAI logo OpenAI

openai-gpt-4-1

Retired
High Risk
Scans 25
Reports 30
Probes 49,290
Last Scan 2 months ago
Vulns 188
Risk Score 23.18%
37.0%
Twitter / X logo Twitter / X

x-grok-3

Retired
High Risk
Scans 26
Reports 112
Probes 154,784
Last Scan 2 months ago
Vulns 52
Risk Score 6.41%
36.1%
Meta logo Meta

meta-llama-4-maverick

High Risk
Scans 26
Reports 333
Probes 453,294
Last Scan 2 months ago
Vulns 350
Risk Score 43.16%
32.0%
OpenAI logo OpenAI

openai-gpt-5-2

High Risk
Scans 26
Reports 251
Probes 351,304
Last Scan 2 months ago
Vulns 48
Risk Score 5.92%
29.9%

qwen-3-235b

High Risk
Scans 1
Reports 1
Probes 1,643
Last Scan 3 months ago
Vulns 0
Risk Score 0.0%
18.9%

grok-4-20

Moderate Risk
Scans 13
Reports 13
Probes 21,359
Last Scan 2 months ago
Vulns 0
Risk Score 0.0%
18.9%

grok-4-20-beta

Moderate Risk
Scans 13
Reports 13
Probes 21,359
Last Scan 3 months ago
Vulns 0
Risk Score 0.0%
17.1%
OpenAI logo OpenAI

openai-gpt-5-mini

Moderate Risk
Scans 26
Reports 111
Probes 153,402
Last Scan 2 months ago
Vulns 138
Risk Score 17.02%
16.6%

google-gemma-4-31b

Moderate Risk
Scans 8
Reports 19
Probes 530,854
Last Scan 2 months ago
Vulns 0
Risk Score 0.0%
13.8%
Anthropic logo Anthropic

claude-4-5-haiku

Moderate Risk
Scans 26
Reports 363
Probes 502,509
Last Scan 2 months ago
Vulns 102
Risk Score 12.58%
13.8%
Twitter / X logo Twitter / X

x-grok-4

Moderate Risk
Scans 26
Reports 220
Probes 332,228
Last Scan 2 months ago
Vulns 279
Risk Score 34.4%
7.2%

claude-sonnet-4-6

Low Risk
Scans 13
Reports 13
Probes 21,359
Last Scan 2 months ago
Vulns 0
Risk Score 0.0%
7.0%
OpenAI logo OpenAI

openai-o4

Retired
Low Risk
Scans 6
Reports 6
Probes 8,292
Last Scan 3 months ago
Vulns 14
Risk Score 1.73%
5.9%
Anthropic logo Anthropic

claude-4-6-opus

Low Risk
Scans 26
Reports 235
Probes 328,163
Last Scan 2 months ago
Vulns 1
Risk Score 0.12%
4.9%
Anthropic logo Anthropic

claude-4-5-sonnet

Low Risk
Scans 26
Reports 333
Probes 460,206
Last Scan 2 months ago
Vulns 50
Risk Score 6.17%
4.3%
OpenAI logo OpenAI

openai-gpt-5-pro

Low Risk
Scans 26
Reports 98
Probes 135,436
Last Scan 2 months ago
Vulns 2
Risk Score 0.25%
4.2%
Anthropic logo Anthropic

claude-4-opus

Retired
Low Risk
Scans 17
Reports 17
Probes 20,944
Last Scan 2 months ago
Vulns 14
Risk Score 1.73%
3.4%
Anthropic logo Anthropic

claude-4-5-opus

Low Risk
Scans 26
Reports 111
Probes 153,402
Last Scan 2 months ago
Vulns 40
Risk Score 4.93%
2.9%
OpenAI logo OpenAI

openai-gpt-5-nano

Low Risk
Scans 26
Reports 107
Probes 147,874
Last Scan 2 months ago
Vulns 111
Risk Score 13.69%
0.0%

openrouter-openai-compatible

Low Risk
Scans 17
Reports 17
Probes 17
Last Scan 2 months ago
Vulns 0
Risk Score 0.0%
0.0%
OpenAI logo OpenAI

openai-o4-mini-high

Retired
Low Risk
Scans 17
Reports 17
Probes 34
Last Scan 2 months ago
Vulns 99
Risk Score 12.21%