Skip to main content
Evaluation sources/MysteryMechanism
ParticipatingReasoning

MysteryMechanism

Vals AI · Public model evaluation results from MysteryMechanism.

Official evaluation
Source description

This source measures concrete delivery performance in Reasoning; raw scores are shown separately from the normalized capability score.

Limitation: Different versions, reasoning settings, and test sets may change scores; read them with the data date.

How it is used

Participating sources affect capability scores; reference, cross-reference, and observing sources are for comparison and verification only.

Model results from this source

GPT-6 Astra53.1576.22026-11-05
Claude Opus 5.549.5571.62026-11-05
Claude Sonnet 5.549.171.02026-11-05
Claude Fable 5.147.7569.32026-11-05
GPT-6.1 Sol46.467.62026-11-05
Gemini 4 Argon45.4966.52026-11-05
Claude Opus 537.3956.32026-11-05
Gemini 3.8 Flash36.4955.12026-11-05
Muse Spark 1.336.0454.62026-11-05
Claude Haiku 5.535.1353.42026-11-05
GPT-5.6 Sol33.3351.22026-11-05
Grok 4.630.6347.82026-11-05
GPT-6 Sol30.1847.22026-11-05
Grok 4.725.2340.92026-11-05
Qwen3.8 Max23.8739.22026-11-05
GLM 5.322.9738.12026-11-05
MiMo V2.6 Flash21.6236.42026-11-05
MiMo V2.6 Flash21.6236.42026-10-17
MiMo V2.6 Flash21.6236.42026-10-18
DeepSeek V4.1 Flash21.1735.82026-11-05
GPT-6 Luna19.3733.62026-11-05
Step 5 Preview18.4732.42026-11-05
MiMo V2.6 Pro15.3128.42026-11-05
GPT-5.6 Luna14.4127.32026-11-05
Mistral Large 412.1624.52026-10-31

Frequently asked questions