Benchmark

Aider-Polyglot

general code text

A coding benchmark that evaluates LLMs on 225 challenging Exercism programming exercises across C++, Go, Java, JavaScript, Python, and Rust. Models receive two attempts to solve each problem, with test error feedback provided after the first attempt if it fails. The benchmark measures both initial problem-solving ability and capacity to edit code based on error feedback, providing an end-to-end evaluation of code generation and editing capabilities across multiple programming languages.

Top 10

榜单概览

1GPT-588.02DeepSeek-V3.2-Exp74.53DeepSeek Reasoner74.24DeepSeek Chat70.25Kimi K2-Instruct-090560.06Qwen3-Next-80B-A3B-Inst…49.8
数据说明

分数为 0-100 百分制综合成绩(Elo 榜为相对评分,仅供同榜内比较)。评测分数属事实数据,整理自公开评测体系与厂商公开资料,部分分数为厂商自报口径,不同榜单的评测方法与数据集可能存在差异,请结合多个榜单交叉参考。

Ranking

模型排名

名次 模型 机构 分数 来源
1 GPT-5 OpenAI 88.0 来源
2 DeepSeek-V3.2-Exp DeepSeek 74.5 来源
3 DeepSeek Reasoner DeepSeek 74.2 来源
4 DeepSeek Chat DeepSeek 70.2 来源
5 Kimi K2-Instruct-0905 Moonshot AI 60.0 来源
6 Qwen3-Next-80B-A3B-Instruct Alibaba Cloud / Qwen Team 49.8 来源