Skip to main content
Evaluation sources/SciCode
ParticipatingCoding

SciCode

Artificial Analysis · Public model evaluation results from SciCode.

Official evaluation
Source description

This source measures concrete delivery performance in Coding; raw scores are shown separately from the normalized capability score.

Limitation: Different versions, reasoning settings, and test sets may change scores; read them with the data date.

How it is used

Participating sources affect capability scores; reference, cross-reference, and observing sources are for comparison and verification only.

Model results from this source

Claude Opus 5.50.6689814877.82026-11-05
Claude Fable 5.10.6307870472.42026-11-05
Muse Wonder Full0.6261574171.82026-10-18
Muse Wonder Full0.6261574171.82026-10-17
Muse Wonder Full0.6261574171.82026-11-05
Gemini 4 Argon0.6180555670.62026-11-05
Claude Fable 50.609953769.52026-11-05
Claude Sonnet 5.50.609953769.52026-11-05
MiMo V2.6 Pro0.608796369.32026-11-05
Muse Wonder0.6030092668.52026-10-18
Muse Wonder0.6030092668.52026-10-17
Muse Wonder0.6030092668.52026-11-05
Muse Spark 1.30.5972222267.72026-11-05
Kimi K30.5949074167.32026-11-05
GLM 5.30.5902777866.72026-11-05
Step 5 Preview0.5891203766.52026-11-05
Muse Spark 1.10.5879629666.42026-11-05
Gemini 3.1 Pro Preview0.5868055666.22026-11-05
GPT-5.6 Sol0.577546364.92026-11-05
Grok 4.70.577546364.92026-11-05
GPT-6 Sol0.5763888964.72026-11-05
Muse Spark 1.20.5740740764.42026-11-05
Ling-3.1-flash-10190.5682870463.62026-11-05
Gemini 3.8 Flash0.5659722263.22026-11-05
Grok 4.60.5648148163.12026-11-05
GPT-6 Astra0.5648148163.12026-11-05
Claude Opus 50.5636574162.92026-11-05
GPT-5.50.5613425962.62026-11-05
DeepSeek V4.1 Flash 10170.5590277862.32026-11-05
GPT-6.1 Sol0.5578703762.12026-11-05
GPT-6.1 Terra0.5509259361.12026-11-05
Grok 4.50.5497685261.02026-11-05
GPT-5.6 Terra0.5497685261.02026-11-05
Claude Haiku 5.50.5497685261.02026-11-05
GPT-6 Luna0.546296360.52026-11-05
Claude Opus 4.80.5439814860.12026-11-05
Claude Sonnet 50.5428240760.02026-11-05
Mistral Large 40.5416666759.82026-10-28
Ling-3.1-flash0.5405092659.62026-11-05
Ling-3.1-flash0.5405092659.62026-10-18
Ling-3.1-flash0.5405092659.62026-10-17
GPT-5.6 Luna0.5358796359.02026-11-05
Gemini 3.6 Flash0.5335648158.72026-11-05
MiniMax M3.1 Flash0.5335648158.72026-11-05
Qwen3.8 Max0.5324074158.52026-11-05
GPT-5.4 mini0.5208333356.92026-11-05
DeepSeek V4.1 Flash0.5185185256.52026-11-05
GLM-5.3 Flash0.516203756.22026-11-05
GLM-5.3 Flash0.516203756.22026-10-17
GLM-5.3 Flash0.516203756.22026-10-18
Kimi K2.60.515046356.02026-11-05
MiMo V2.6 Flash0.5127314855.72026-10-18
MiMo V2.6 Flash0.5127314855.72026-10-17
MiMo V2.6 Flash0.5127314855.72026-11-05
GLM-5.20.5115740755.52026-11-05
DeepSeek V4 Pro 08130.5104166755.42026-11-05
DeepSeek V4 Pro0.5081018555.12026-11-05
MiMo-V2.5-Pro0.5057870454.72026-11-05
DeepSeek V4 Flash 07310.5034722254.42026-11-05
Claude Sonnet 4.60.5011574154.12026-11-05
MiniMax-M2.70.5011574154.12026-11-05
Inkling Small0.4965277853.42026-11-05
Qwen3.7 Max0.4953703753.32026-11-05
Hy30.4861111151.92026-11-05
Grok 4.30.4826388951.52026-11-05
Kimi K2.7 Code0.4780092650.82026-11-05
MiniMax-M30.4710648149.82026-11-05
Inkling0.4699074149.72026-11-05
Gemini 2.5 Pro0.4629629648.72026-11-05
Qwen3.7 Plus0.4606481548.32026-11-05
Claude Sonnet 4.50.4571759347.82026-11-05
Ring-2.6-1T0.4502314846.92026-11-05
Qwen3.5 397B-A17B0.4479166746.52026-11-05
GLM-5.10.4479166746.52026-11-05
MiMo-V2.50.4386574145.22026-11-05
Step 3.7 Flash0.4386574145.22026-11-05
Gemini 3.1 Flash Lite0.4340277844.62026-11-05
Nex-N2-Pro0.4328703744.42026-11-05
o3-mini0.4282407443.82026-10-11
o3 Mini High0.4282407443.82026-11-05
Qwen3.6 27B0.4282407443.82026-11-05
Claude Haiku 4.50.422453742.92026-11-05
Ling-3.0-flash (free)0.4201388942.62026-11-05
Gemini 3.5 Flash Lite0.4131944441.62026-11-05
Trinity Large Thinking0.4062540.62026-11-05
Nemotron 3 Ultra 550B A55B0.4027777840.22026-11-05
Mistral Medium 3.50.4016203740.02026-11-05
Qwen3.5 122B-A10B0.3969907439.32026-11-05
DeepSeek V3 03240.390046338.42026-11-05
GPT-5 mini0.390046338.42026-11-05
gpt-oss-20b0.3888888938.22026-11-05
North Mini Code0.3877314838.02026-11-05
Command A Plus0.3854166737.72026-11-05
DeepSeek-R10.3831018537.42026-11-05
DeepSeek V3.1 Terminus0.3796296336.92026-11-05
Mercury 20.3773148136.52026-11-05
Mistral Large 30.3657407434.92026-11-05
Qwen3.6 35B-A3B0.3657407434.92026-11-05
LongCat-2.00.3634259334.62026-11-05
Qwen3 Coder Next0.3622685234.42026-11-05
Nemotron 3 Super 120B A12B0.3622685234.42026-11-05
Qwen3 32B0.359953734.12026-11-05
gpt-oss-120b0.3402777831.32026-11-05
Llama 4 Maverick0.3171296328.02026-11-05
Qwen3 14B0.3067129626.62026-11-05
Nemotron 3 Nano 30B A3B0.3055555626.42026-11-05
Qwen3.5 9B0.2951388924.92026-11-05
Qwen3 8B0.2789351922.62026-11-05
Solar Pro 30.2546296319.22026-11-05
Ministral 3 14B0.2384259316.92026-11-05
Llama 4 Scout0.2129629613.32026-11-05
Ministral 3 8B0.2071759312.52026-11-05
Ministral 3 3B0.152777784.82026-11-05

Frequently asked questions