Benchmark

MBPP+

reasoning general text

MBPP+ is an enhanced version of MBPP (Mostly Basic Python Problems) with significantly more test cases (35x) for more rigorous evaluation. MBPP is a benchmark of 974 crowd-sourced Python programming problems designed to be solvable by entry-level programmers, covering programming fundamentals and standard library functionality.

语言EN
满分1
参评模型2

模型排名

名次 模型 机构 分数 来源
1 Qwen2.5 32B Instruct Alibaba Cloud / Qwen Team 67.2 来源 ↗
2 Qwen2.5 14B Instruct Alibaba Cloud / Qwen Team 63.2 来源 ↗