Skip to main content
Evaluation sources/DeepSWE
ObservingCoding

DeepSWE

Datacurve · Public model evaluation results from DeepSWE.

Official evaluation
Source description

This source measures concrete delivery performance in Coding; raw scores are shown separately from the normalized capability score.

Limitation: Different versions, reasoning settings, and test sets may change scores; read them with the data date.

How it is used

Participating sources affect capability scores; reference, cross-reference, and observing sources are for comparison and verification only.

Model results from this source

GPT-5.6 Sol72.772.72026-07-09
GPT-5.6 Terra69.669.62026-07-09
GPT-5.6 Luna67.267.22026-07-09
Grok 4.56262.02026-07-08
Muse Spark 1.153.353.32026-07-09
Grok 4.55353.02026-07-08

Frequently asked questions