Independent tests of AI security agents and SOC decision models. DFIR results, evidence checks and practical findings. Follow for new benchmark results.
We’ve completed our first Meta Muse benchmarks.
Spark 1.3 holds the top spot for Muse. However, it still trailed GPT, Gemini and Claude Opus on single-host proof scores.
secbenchmarks.com/blog/2026-…
ALT Meta Muse Model Performance in SOC Investigations. Verdicts with accepted proof, Single Host Intrusion / Multi-Host Intrusion: Muse Spark 1.3 11/36 and 4/12; Muse Wonder 9/36 and 4/12; Muse Spark Open 1/36 and 1/12; GPT-6.1 Sol 25/36 and 5/12; GPT-6 Astra 25/36 and 5/12; Gemini 4 Argon 29/36 and 4/12; Claude Opus 5.5 12/36 and 5/12; Claude Sonnet 5.5 11/36 and 4/12. All High effort. One pass; preliminary.