Benchmark
MathVista-Mini
math
vision
multimodal
multimodal
MathVista-Mini is a smaller version of the MathVista benchmark that evaluates mathematical reasoning in visual contexts. It consists of examples derived from multimodal datasets involving mathematics, combining challenges from diverse mathematical and visual tasks to assess foundation models' ability to solve problems requiring both visual understanding and mathematical reasoning.
语言EN
满分1
参评模型7
模型排名
| 名次 | 模型 | 机构 | 分数 | 来源 |
|---|---|---|---|---|
| 1 | Qwen2.5 VL 72B Instruct | Alibaba Cloud / Qwen Team | 74.8 | 来源 ↗ |
| 2 | Qwen2.5 VL 32B Instruct | Alibaba Cloud / Qwen Team | 74.7 | 来源 ↗ |
| 3 | Qwen2-VL-72B-Instruct | Alibaba Cloud / Qwen Team | 70.5 | 来源 ↗ |
| 4 | Qwen2.5 VL 7B Instruct | Alibaba Cloud / Qwen Team | 68.2 | 来源 ↗ |
| 5 | Gemma 3 27B | 67.6 | 来源 ↗ | |
| 6 | Gemma 3 12B | 62.9 | 来源 ↗ | |
| 7 | Gemma 3 4B | 50.0 | 来源 ↗ |