Large Language Model

Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?

CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editions

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

ACT-SQL: In-Context Learning for Text-to-SQL with Automatically-Generated Chain-of-Thought

Mobile-Env: Building Qualified Evaluation Benchmarks for LLM-GUI Interaction