Benchmark

MEGA XCOPA

reasoning language text 多语言

XCOPA (Cross-lingual Choice of Plausible Alternatives) as part of the MEGA benchmark suite. A typologically diverse multilingual dataset for causal commonsense reasoning in 11 languages, including resource-poor languages like Eastern Apurímac Quechua and Haitian Creole. Requires models to select which choice is the effect or cause of a given premise.

语言EN
满分1
参评模型2

模型排名

名次 模型 机构 分数 来源
1 Phi-3.5-MoE-instruct Microsoft 76.6 来源 ↗
2 Phi-3.5-mini-instruct Microsoft 63.1 来源 ↗