Benchmark

ScreenSpot Pro

vision multimodal spatial_reasoning multimodal

ScreenSpot-Pro is a novel GUI grounding benchmark designed to rigorously evaluate the grounding capabilities of multimodal large language models (MLLMs) in professional high-resolution computing environments. The benchmark comprises 1,581 instructions across 23 applications spanning 5 industries and 3 operating systems, featuring authentic high-resolution images from professional domains with expert annotations. Unlike previous benchmarks that focus on cropped screenshots in consumer applications, ScreenSpot-Pro addresses the complexity and diversity of real-world professional software scenarios, revealing significant performance gaps in current MLLM GUI perception capabilities.

语言EN
满分1
参评模型3

模型排名

名次 模型 机构 分数 来源
1 Qwen2.5 VL 72B Instruct Alibaba Cloud / Qwen Team 43.6 来源 ↗
2 Qwen2.5 VL 32B Instruct Alibaba Cloud / Qwen Team 39.4 来源 ↗
3 Qwen2.5 VL 7B Instruct Alibaba Cloud / Qwen Team 29.0 来源 ↗