Benchmark

MEGA TyDi QA

language reasoning text 多语言

TyDi QA as part of the MEGA benchmark suite. A question answering dataset covering 11 typologically diverse languages (Arabic, Bengali, English, Finnish, Indonesian, Japanese, Korean, Russian, Swahili, Telugu, and Thai) with 204K question-answer pairs. Features realistic information-seeking questions written by people who want to know the answer but don't know it yet.

语言EN
满分1
参评模型2

模型排名

名次 模型 机构 分数 来源
1 Phi-3.5-MoE-instruct Microsoft 67.1 来源 ↗
2 Phi-3.5-mini-instruct Microsoft 62.2 来源 ↗