ObservingCoding

SWE Bench Pro

Scale AI · Public model evaluation results from SWE Bench Pro.

Source description

This source measures concrete delivery performance in Coding; raw scores are shown separately from the normalized capability score.

Limitation: Different versions, reasoning settings, and test sets may change scores; read them with the data date.

How it is used

Participating sources affect capability scores; reference, cross-reference, and observing sources are for comparison and verification only.

Model results from this source


Fugu Ultra	73.7	73.7	2026-08-05
Fugu	59	59.0	2026-08-05