ScreenAI: A Vision-Language Model for UI and Infographics Understanding
Paper
•
2402.04615
•
Published
•
36
Screen Agents
Papers related to web agents, screen agents, autonomous agents that can mimic human users in computer and/or web use
-
-
WebArena: A Realistic Web Environment for Building Autonomous Agents
Paper • 2307.13854 • Published • 23 -
Mind2Web: Towards a Generalist Agent for the Web
Paper • 2306.06070 • Published • 19 -
Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation
Paper • 2410.13232 • Published • 39 -
Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale
Paper • 2409.08264 • Published • 43 -
Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs
Paper • 2404.05719 • Published • 80 -
Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents
Paper • 2408.07199 • Published • 20 -
OmniParser for Pure Vision Based GUI Agent
Paper • 2408.00203 • Published • 22 -
OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
Paper • 2404.07972 • Published • 43 -
A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis
Paper • 2307.12856 • Published • 35 -
Agent Workflow Memory
Paper • 2409.07429 • Published • 27 -
Agent S: An Open Agentic Framework that Uses Computers Like a Human
Paper • 2410.08164 • Published • 24 -
SAM 2: Segment Anything in Images and Videos
Paper • 2408.00714 • Published • 106