news LinkedIn

A British psychologist wrote a paper in 1983 that predicted every single problem we’re having with AI in 2026. It's called “Ironies of Automation” The more advanced and reliable an automated system… | Patrick Slavenburg | 31 comments

The post argues that Lisanne Bainbridge’s 1983 paper, *Ironies of Automation*, anticipated major risks associated with modern AI systems. Its central warning is that as automation becomes more reliable, human operators become responsible mainly for rare, complex, and potentially dangerous exceptions—the very situations least amenable to routine procedures. Meanwhile, frequent reliance on AI can erode people’s practical skills and mental models. When an AI system fails or “hallucinates,” humans may be expected to intervene despite being out of practice and confronted with an urgent, difficult problem. The discussion also challenges the idea that simply placing a human “in the loop” ensures safety. Humans are poor at maintaining vigilance for rare failures, and they may be unable to evaluate systems operating faster and more complexly than they can follow. Oversight therefore requires more than approving outputs: it needs accountability, independent safeguards, clear operational boundaries, fault recovery, and mechanisms for detecting missing reports or silent failures. Commenters broaden the issue beyond AI, comparing it with Socrates’ concerns about writing and with decades of industrial automation experience. They emphasize that effective use of agents depends on curiosity, asking informed questions, challenging outputs, and maintaining engagement rather than accepting results uncritically. AI may expand human capabilities, but current processes remain immature. The main risk is not automation alone, but systems that preserve human responsibility while degrading human judgment, creating an illusion of control and potentially concentrating blame on weakened supervisors.

Build this article’s timeline

Extract dated events, key actors, and open questions using the same timeline analysis available in Signal.

Log in to build

Timeline generation is available to signed-in community members.

Five Ws 🤖 3 AI prefills · 2 still unanswered
Who
Lisanne Bainbridge, Socrates, Fabien Ninoles, and LinkedIn
🤖 AI prefill
What
The post argues that Lisanne Bainbridge’s 1983 paper, *Ironies of Automation*, anticipated major risks associated with modern AI systems.
🤖 AI prefill
When When did this happen, or what is the timeframe?
Where Where did this occur?
Why
Centers on Ironies of Automation, human operator, and human oversight
🤖 AI prefill

Login to answer and earn XP for each gap you fill.

Automation Skill Degradation Ironies of Automation, skill degradation, human operator, edge cases, cognitive skills Human Oversight Accountability human oversight, accountability, intervention, responsibility, meaningful judgment AI Systems Engineering system architecture, safety controls, fault recovery, business processes, reliable data Engaged Human Collaboration curiosity, engagement, ownership, questioning, challenge Automation Speed Limits AI speed, human cognition, real-time checking, black box, vigilance
Ironies of Automation100% human operator91% human oversight95% operator skill degradation94% exception handling88% monitoring illusion90% AI agents93% agentic workflows86% vibe coding78% black-box systems84%
38
Manipulation Score: Medium How much this article uses emotional framing vs. straight reporting
Loaded Language 3825%
Absolutist 4815%
Threat/Panic 4225%
Us vs Them 1215%
Engagement Bait 3520%
Manipulation score look right?

Factual Claims (10)

low other
A British psychologist wrote a paper in 1983 called "Ironies of Automation."
high technology
The paper predicted every single problem people are having with AI in 2026.
medium technology
As automated systems become more advanced and reliable, the human operator becomes more crucial.
medium technology
Automation tends to leave humans responsible for complex, chaotic, and dangerous edge cases.
medium scientific
Cognitive skills deteriorate when they are not actively used.
medium technology
If AI performs 99% of the work, humans may lose a deep mental model of the codebase or system.
medium scientific
Humans are biologically poor at maintaining vigilance while waiting for rare errors.
high technology
It is physically impossible for a human to check an AI system's logic in real time when it processes data faster than the human.
medium technology
AI does not remove human error but may delay it until a particularly consequential moment.
medium technology
Industrial automation engineers addressed many current AI oversight challenges more than 40 years ago.

Comments

Login to view and post comments.

🏠Portal 📰Links ❓Q&A 📅Events 💼Jobs