Ironies of automation

The paradox that automating the easy parts of a task leaves humans with the harder residual work of monitoring and recovering systems whose inner workings they no longer practice or understand.

grounded in: Trend theme 'Automation without comprehension: growing unease that agents automate tasks nobody actually understands anymore' — Bainbridge's enduring HCI framing of that exact failure mode.

Connected concepts

Reverse centaur, Deskilling, Verification bottleneck, Human-on-the-loop oversight, Epistemic debt