评测来源/SWE-Bench Pro
观察中编程
SWE-Bench Pro
Scale AI · SWE-Bench Pro 的公开模型评测结果。
本来源的模型成绩
| Claude Fable 5 | 80.3 | 80.3 | 2026-06-09 |
| Claude Opus 4.8 | 69.2 | 69.2 | 2026-05-28 |
| Grok 4.5 | 64.7 | 64.7 | 2026-07-08 |
| GPT-5.6 Sol | 64.6 | 64.6 | 2026-07-09 |
| Claude Opus 4.7 | 64.3 | 64.3 | 2026-05-28 |
| GPT-5.6 Terra | 63.4 | 63.4 | 2026-07-09 |
| Claude Sonnet 5 | 63.2 | 63.2 | 2026-06-30 |
| GPT-5.6 Luna | 62.7 | 62.7 | 2026-07-09 |
| Ornith 1.0 397B | 62.2 | 62.2 | 2026-08-05 |
| GLM-5.2 | 62.1 | 62.1 | 2026-06-16 |
| Muse Spark 1.1 | 61.5 | 61.5 | 2026-07-09 |
| Qwen3.7 Max | 60.6 | 60.6 | 2026-05-19 |
| LongCat-2.0 | 59.5 | 59.5 | 2026-06-30 |
| GPT-5.4 | 59.1 | 59.1 | 2026-08-05 |
| MiniMax-M3 | 59 | 59.0 | 2026-06-01 |
| GPT-5.5 | 58.6 | 58.6 | 2026-05-28 |
| MiMo-V2.5-Pro | 57.2 | 57.2 | 2026-04-22 |
| Step 3.7 Flash | 56.3 | 56.3 | 2026-05-29 |
| MiniMax-M2.7 | 56.2 | 56.2 | 2026-06-01 |
| Gemini 3.1 Pro Preview | 54.2 | 54.2 | 2026-05-28 |
| Claude Opus 4.6 | 51.9 | 51.9 | 2026-08-05 |
| MAI-Code-1-Flash | 51.2 | 51.2 | 2026-06-02 |
| Ornith 1.0 35B | 50.4 | 50.4 | 2026-08-05 |
| Laguna XS 2.1 | 47.6 | 47.6 | 2026-07-02 |
| Gemini 3.1 Pro Preview | 46.1 | 46.1 | 2026-08-05 |
| Claude Opus 4.5 | 45.89 | 45.9 | 2026-08-05 |
| Claude Opus 4.7 | 44.9 | 44.9 | 2026-08-05 |
| Claude Sonnet 4.5 | 43.6 | 43.6 | 2026-08-05 |
| Gemini 3 Pro Preview | 43.3 | 43.3 | 2026-08-05 |
| Ornith 1.0 9B | 42.9 | 42.9 | 2026-08-05 |
| GPT-5 | 41.78 | 41.8 | 2026-08-05 |
| North Mini Code | 40.2 | 40.2 | 2026-06-09 |
| Claude Haiku 4.5 | 39.45 | 39.5 | 2026-08-05 |
| Qwen3-Coder 480B-A35B Instruct | 38.7 | 38.7 | 2026-08-05 |
| MiniMax-M2.1 | 36.81 | 36.8 | 2026-08-05 |
| Claude Opus 4.7 | 36.4 | 36.4 | 2026-08-05 |
| Gemini 3 Flash Preview | 34.63 | 34.6 | 2026-08-05 |
| Claude Opus 4.7 | 34.4 | 34.4 | 2026-08-05 |
| GPT-5.5 | 30.9 | 30.9 | 2026-08-05 |
| GPT-5.2 | 29.94 | 29.9 | 2026-08-05 |
| Kimi K2.6 | 27.3 | 27.3 | 2026-08-05 |
| GPT-5.5 | 26.2 | 26.2 | 2026-08-05 |
| GPT-5.5 | 24.9 | 24.9 | 2026-08-05 |
| Qwen3 235B-A22B | 21.41 | 21.4 | 2026-08-05 |
| GLM-5.1 | 19.8 | 19.8 | 2026-08-05 |
| GPT-5.4 | 18.9 | 18.9 | 2026-08-05 |
| GPT-5.4 | 18.4 | 18.4 | 2026-08-05 |
| DeepSeek V4 Pro | 18 | 18.0 | 2026-08-05 |
| Gemini 3.1 Pro Preview | 15.1 | 15.1 | 2026-08-05 |
| Claude Sonnet 4.6 | 14.9 | 14.9 | 2026-08-05 |
| Claude Opus 4.6 | 11.8 | 11.8 | 2026-08-05 |
| GLM-4.6 | 9.67 | 9.7 | 2026-08-05 |
| Llama 4 Maverick 17B Instruct | 5.24 | 5.2 | 2026-08-05 |