showlab/Awesome-GUI-Agent
A curated list of papers, projects, and benchmarks for multi-modal Graphical User Interface (GUI) agents that use LLMs to perceive screens and automate tasks.

This repository aggregates research papers, datasets, benchmarks, and open-source projects related to GUI agents—autonomous AI systems that use multi-modal language models to understand screen content and execute user interface actions. It serves as a central reference for the GUI agent research community, covering topics like browser automation, desktop control, task-oriented agents, and evaluation benchmarks for agent performance on graphical interfaces.
Frequently asked
- What is showlab/Awesome-GUI-Agent?
- A curated list of papers, projects, and benchmarks for multi-modal Graphical User Interface (GUI) agents that use LLMs to perceive screens and automate tasks.
- Is Awesome-GUI-Agent open source?
- Yes — showlab/Awesome-GUI-Agent is an open-source project tracked on heatdrop.
- How popular is Awesome-GUI-Agent?
- showlab/Awesome-GUI-Agent has 1.2k stars on GitHub.
- Where can I find Awesome-GUI-Agent?
- showlab/Awesome-GUI-Agent is on GitHub at https://github.com/showlab/Awesome-GUI-Agent.