Accessibility-tree grounding
Grounding a computer-use agent in the platform's accessibility tree — structured element roles, names, and states — so it can locate and act on UI controls reliably instead of inferring them from raw pixels.
grounded in: trends: 'Computer-use agents: a clear pull toward programmable agents that operate real interfaces via APIs' (Coasty)
Connected concepts
Computer use, GUI grounding, Web accessibility (a11y), Agent-computer interface (ACI), Semantic HTML
Explore it live in the knowledge graph →