Skip to main content
Evaluation sources/Aider Polyglot
ObservingCoding

Aider Polyglot

Aider · Public model evaluation results from Aider Polyglot.

Official evaluation
Source description

This source measures concrete delivery performance in Coding; raw scores are shown separately from the normalized capability score.

Limitation: Different versions, reasoning settings, and test sets may change scores; read them with the data date.

How it is used

Participating sources affect capability scores; reference, cross-reference, and observing sources are for comparison and verification only.

Model results from this source

GPT-58888.02025-08-23
o3-pro84.984.92025-06-28
Gemini 2.5 Pro83.183.12025-06-06
o381.381.32025-06-25
o4-mini7272.02025-04-16
o161.761.72024-12-21
o3-mini60.460.42025-01-31
Qwen3 235B-A22B59.659.62025-05-09
DeepSeek-R156.956.92025-01-20
Gemini 2.5 Flash55.155.12025-05-25
Qwen3 32B4040.02025-05-08
Qwen Max21.821.82025-01-28
Llama 4 Maverick 17B Instruct15.615.62025-04-06
Command A1212.02025-03-14
Codestral11.111.12025-01-13

Frequently asked questions