Benchmark
TempCompass
vision
multimodal
reasoning
multimodal
TempCompass is a comprehensive benchmark for evaluating temporal perception capabilities of Video Large Language Models (Video LLMs). It constructs conflicting videos that share identical static content but differ in specific temporal aspects to prevent models from exploiting single-frame bias. The benchmark evaluates multiple temporal aspects including action, motion, speed, temporal order, and attribute changes across diverse task formats including multi-choice QA, yes/no QA, caption matching, and caption generation.
Top 10
榜单概览
数据说明
分数为 0-100 百分制综合成绩（Elo 榜为相对评分，仅供同榜内比较）。评测分数属事实数据，整理自公开评测体系与厂商公开资料，部分分数为厂商自报口径，不同榜单的评测方法与数据集可能存在差异，请结合多个榜单交叉参考。
Ranking
模型排名
暂无评测数据。