Measuring AI-Induced Disempowerment: A Framework and Proposed Metrics

· Source: Paper Index on ACL Anthology · Field: Science & Research — Social Sciences & Behavioral Studies, Research Methodology & Innovation · Depth: Expert, quick

Summary

A new framework and proposed metrics address the urgent need to measure AI-induced disempowerment, which tracks whether AI integration erodes humans' ability to meaningfully shape outcomes. The research operationalizes disempowerment using Sen's model of agency and a three-layer model encompassing exposure, erosion, and lock-in, applied across economic, political, and cultural domains at individual, institutional, and civilizational scales. Current measurement efforts are shown to cluster almost entirely at exposure, neglecting erosion and lock-in. Six concrete metrics are proposed: centaur evaluations, disempowerment perception surveys, AI content saturation and cultural convergence monitoring, monitoring capital flow to and from human labor, human task frontier tracking, and institutional ethnography. The paper also identifies key actors for implementation and discusses limitations like construct validity and causal attribution.

Key takeaway

For Policy Makers and Research Scientists developing AI impact assessments, recognize that current metrics often overlook AI-induced erosion and lock-in of human agency. You should integrate the proposed three-layer model and six concrete metrics, such as centaur evaluations and cultural convergence monitoring, to comprehensively track disempowerment across economic, political, and cultural domains. This ensures a more robust understanding of AI's societal effects and informs more responsible AI governance.

Key insights

Measuring AI-induced disempowerment requires a multi-layered framework and specific metrics beyond mere exposure.

Principles

Method

The paper proposes a research agenda to measure AI-induced disempowerment using a three-layer model (exposure, erosion, lock-in) and six concrete metrics, identifying actors best positioned to implement each.

In practice

Topics

Best for: AI Scientist, AI Ethicist, Policy Maker, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.