Measuring AI-Induced Disempowerment: A Framework and Proposed Metrics
Summary
A new framework and proposed metrics address the urgent need to measure AI-induced disempowerment, which tracks whether AI integration erodes humans' ability to meaningfully shape outcomes. The research operationalizes disempowerment using Sen's model of agency and a three-layer model encompassing exposure, erosion, and lock-in, applied across economic, political, and cultural domains at individual, institutional, and civilizational scales. Current measurement efforts are shown to cluster almost entirely at exposure, neglecting erosion and lock-in. Six concrete metrics are proposed: centaur evaluations, disempowerment perception surveys, AI content saturation and cultural convergence monitoring, monitoring capital flow to and from human labor, human task frontier tracking, and institutional ethnography. The paper also identifies key actors for implementation and discusses limitations like construct validity and causal attribution.
Key takeaway
For Policy Makers and Research Scientists developing AI impact assessments, recognize that current metrics often overlook AI-induced erosion and lock-in of human agency. You should integrate the proposed three-layer model and six concrete metrics, such as centaur evaluations and cultural convergence monitoring, to comprehensively track disempowerment across economic, political, and cultural domains. This ensures a more robust understanding of AI's societal effects and informs more responsible AI governance.
Key insights
Measuring AI-induced disempowerment requires a multi-layered framework and specific metrics beyond mere exposure.
Principles
- Disempowerment can be operationalized via Sen's agency model.
- AI's impact spans exposure, erosion, and lock-in layers.
- Measurement must cover economic, political, and cultural domains.
Method
The paper proposes a research agenda to measure AI-induced disempowerment using a three-layer model (exposure, erosion, lock-in) and six concrete metrics, identifying actors best positioned to implement each.
In practice
- Implement centaur evaluations for human-AI collaboration.
- Conduct disempowerment perception surveys.
- Monitor AI content saturation and cultural convergence.
Topics
- AI Disempowerment
- Human Agency
- AI Impact Measurement
- Ethical AI
- Societal AI Effects
- AI Governance
Best for: AI Scientist, AI Ethicist, Policy Maker, Research Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.