raghu@dark-factory :~/kb/accessibility-tree-grounding $ cat

Accessibility-tree grounding

Grounding a computer-use agent in the platform's accessibility tree — structured element roles, names, and states — so it can locate and act on UI controls reliably instead of inferring them from raw pixels.

grounded in: trends: 'Computer-use agents: a clear pull toward programmable agents that operate real interfaces via APIs' (Coasty)

Connected concepts

Computer use, GUI grounding, Web accessibility (a11y), Agent-computer interface (ACI), Semantic HTML

Explore it live in the knowledge graph →