Benchmark
Video-MME
multimodal
vision
reasoning
multimodal
多语言
Video-MME is the first-ever comprehensive evaluation benchmark of Multi-modal Large Language Models (MLLMs) in video analysis. It features 900 videos totaling 254 hours with 2,700 human-annotated question-answer pairs across 6 primary visual domains (Knowledge, Film & Television, Sports Competition, Life Record, Multilingual, and others) and 30 subfields. The benchmark evaluates models across diverse temporal dimensions (11 seconds to 1 hour), integrates multi-modal inputs including video frames, subtitles, and audio, and uses rigorous manual labeling by expert annotators for precise assessment.
Top 10
榜单概览
数据说明
分数为 0-100 百分制综合成绩（Elo 榜为相对评分，仅供同榜内比较）。评测分数属事实数据，整理自公开评测体系与厂商公开资料，部分分数为厂商自报口径，不同榜单的评测方法与数据集可能存在差异，请结合多个榜单交叉参考。
Ranking
模型排名
暂无评测数据。