AI risks: Human-Computer Interaction

2 of the 24 risks sit in this group. Experts rate loss of human agency the most severe of them, at 11.5% probability of a catastrophic outcome by 2030, with a pragmatic-mitigations estimate of 6.7% — the difference between the two estimates is 4.8 points.

Grouping 5 from the MIT AI Risk Repository, used under CC BY 4.0.

Every risk under Human-Computer Interaction

5.2Loss of human agency11.5%Humans delegating key decisions to AI systems, or AI systems making decisions that diminish human control and autonomy, potentially leading to humans feeling disempowered, losing the ability to shape a fulfilling life trajectory or becoming cognitively enfeebled.
5.1Overreliance on AI10.7%Users anthropomorphizing, trusting, or relying on AI systems, leading to emotional or material dependence and inappropriate relationships with or expectations of AI systems. Trust can be exploited by malicious actors (e.g., to harvest personal information or enable manipulation), or result in harm from inappropriate use of AI in critical situations (e.g., medical emergency). Overreliance on AI systems can compromise autonomy and weaken social ties.