Evaluation sources/Artificial Analysis Coding Index
ObservingKnowledge & language
Artificial Analysis Coding Index
Artificial Analysis · Public model evaluation results from Artificial Analysis Coding Index.
Model results from this source
| Step 3.7 Flash | 37.1 | 37.1 | 2026-06-15 |
| Step 3.5 Flash 2603 | 34.6 | 34.6 | 2026-06-02 |
| North Mini Code | 33.4 | 33.4 | 2026-06-09 |
| Gemini 2.5 Pro | 32 | 32.0 | 2026-06-02 |
| Step 3.5 Flash | 31.6 | 31.6 | 2026-06-02 |
| GLM-4.6 | 29.5 | 29.5 | 2026-05-22 |
| Qwen3 Max | 26.4 | 26.4 | 2026-05-30 |
| GLM-4.5 | 26.3 | 26.3 | 2026-03-11 |
| Mistral Small 4 | 24.3 | 24.3 | 2026-06-01 |
| GLM-4.5-Air | 23.8 | 23.8 | 2026-05-30 |
| Mistral Large 3 | 22.7 | 22.7 | 2026-06-04 |
| Gemini 2.5 Flash | 22.2 | 22.2 | 2026-06-02 |
| Qwen3-Coder 30B-A3B Instruct | 19.4 | 19.4 | 2026-06-02 |
| DeepSeek-R1 | 15.9 | 15.9 | 2026-03-11 |
| GPT-4 | 13.1 | 13.1 | 2026-03-11 |
| GLM-4.5V | 10.9 | 10.9 | 2026-04-29 |
| GPT-3.5 Turbo | 10.7 | 10.7 | 2026-03-11 |
| Llama-3.3-70B-Instruct | 10.7 | 10.7 | 2026-03-11 |
| Gemini 2.5 Flash-Lite | 9.5 | 9.5 | 2026-03-11 |