Interface Interaction and Understanding

Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Mobile-Env: Building Qualified Evaluation Benchmarks for LLM-GUI Interaction