Skip to main content
ObservingCoding

NL2Repo

MAP · Public model evaluation results from NL2Repo.

Official evaluation
Source description

This source measures concrete delivery performance in Coding; raw scores are shown separately from the normalized capability score.

Limitation: Different versions, reasoning settings, and test sets may change scores; read them with the data date.

How it is used

Participating sources affect capability scores; reference, cross-reference, and observing sources are for comparison and verification only.

Model results from this source

Ornith 1.0 397B48.248.22026-08-05
Qwen3.7 Max47.247.22026-05-19
Ornith 1.0 35B34.634.62026-08-05
Ornith 1.0 9B27.227.22026-08-05

Frequently asked questions