Artificial Intelligence #gui agents#coding agents
ScaleWoB Framework Synthesizes Realistic Environments to Evaluate GUI Agents at Scale
ScaleWoB is a new framework that generates high-fidelity synthesized interactive environments for evaluating GUI agents across mobile, desktop, and automotive platforms. It includes 100+ environments and 1000+ verifiable tasks. Experiments on five state-of-the-art mobile GUI agents show an average success rate of only 27.92%, compared to 92.08% for humans, highlighting substantial room for improvement.
Jun 22, 2026 1 source