Benchmark

SciCode

reasoning math physics chemistry code text

SciCode is a research coding benchmark curated by scientists that challenges language models to code solutions for scientific problems. It contains 338 subproblems decomposed from 80 challenging main problems across 16 natural science sub-fields including mathematics, physics, chemistry, biology, and materials science. Problems require knowledge recall, reasoning, and code synthesis skills.

Top 10

榜单概览

1Fugu60.12Fugu Ultra58.73Qwen3.7 Max53.54GLM-4.541.75Step 3.5 Flash40.46Step 3.7 Flash40.07Step 3.5 Flash 260338.58Qwen3 Max38.39Mistral Small 438.010GLM-4.5-Air37.3
数据说明

分数为 0-100 百分制综合成绩(Elo 榜为相对评分,仅供同榜内比较)。评测分数属事实数据,整理自公开评测体系与厂商公开资料,部分分数为厂商自报口径,不同榜单的评测方法与数据集可能存在差异,请结合多个榜单交叉参考。

Ranking

模型排名

名次 模型 机构 分数 来源
1 Fugu Sakana AI 60.1 来源
2 Fugu Ultra Sakana AI 58.7 来源
3 Qwen3.7 Max Alibaba Cloud / Qwen Team 53.5 来源
4 GLM-4.5 Zhipu AI 41.7 来源
5 Step 3.5 Flash StepFun 40.4 来源
6 Step 3.7 Flash StepFun 40.0 来源
7 Step 3.5 Flash 2603 StepFun 38.5 来源
8 Qwen3 Max Alibaba Cloud / Qwen Team 38.3 来源
9 Mistral Small 4 Mistral AI 38.0 来源
10 GLM-4.5-Air Zhipu AI 37.3 来源
11 Devstral 2 Mistral AI 33.1 来源