Benchmark
BigCodeBench
general
reasoning
text
A benchmark that challenges LLMs to invoke multiple function calls as tools from 139 libraries and 7 domains for 1,140 fine-grained programming tasks. Evaluates code generation with diverse function calls and complex instructions, featuring two variants: Complete (code completion based on comprehensive docstrings) and Instruct (generating code from natural language instructions).
Top 10
榜单概览
数据说明
分数为 0-100 百分制综合成绩（Elo 榜为相对评分，仅供同榜内比较）。评测分数属事实数据，整理自公开评测体系与厂商公开资料，部分分数为厂商自报口径，不同榜单的评测方法与数据集可能存在差异，请结合多个榜单交叉参考。
Ranking
模型排名
暂无评测数据。