Measuring AI-Induced Disempowerment: A Framework and Proposed Metrics

Je Qin Chooi, Jaeho Lee, Jasmine Xinze Li


Abstract
AI systems are embedded in economic production, public discourse, governance, and personal decision-making, yet there is little empirical infrastructure for tracking whether this integration erodes humans’ ability to meaningfully shape outcomes that affect their lives. We argue that measuring AI-induced disempowerment is both urgent and tractable, and lay out a research agenda for doing so. We first operationalize disempowerment through Sen’s model of agency and a three-layer model of exposure, erosion, and lock-in, applied across economic, political, and cultural domains at individual, institutional, and civilizational scales. We survey existing measurement efforts and show that current work clusters almost entirely at exposure, leaving erosion and lock-in largely unaddressed. We then propose six concrete metrics (centaur evaluations, disempowerment perception surveys, AI content saturation and cultural convergence monitoring, monitoring capital flow to and from human labor, human task frontier tracking, and institutional ethnography) and identify which actors are best positioned to implement each. We close by discussing limitations and open challenges, including construct validity across levels of analysis, causal attribution, the distinction between disempowerment and adaptation, and the political economy of measurement.
Anthology ID:
2026.evaleval-1.36
Volume:
Proceedings of the Workshop on Evaluating Evaluations (EvalEval)
Month:
July
Year:
2026
Address:
San Diego, CA
Editors:
Mubashara Akhtar, Jan Batzner, Leshem Choshen, Avijit Ghosh, Usman Gohar, Jennifer Mickel, Ichhya Pant, Zeerak Talat, Michelle Lin
Venues:
EvalEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
227–236
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.evaleval-1.36/
DOI:
Bibkey:
Cite (ACL):
Je Qin Chooi, Jaeho Lee, and Jasmine Xinze Li. 2026. Measuring AI-Induced Disempowerment: A Framework and Proposed Metrics. In Proceedings of the Workshop on Evaluating Evaluations (EvalEval), pages 227–236, San Diego, CA. Association for Computational Linguistics.
Cite (Informal):
Measuring AI-Induced Disempowerment: A Framework and Proposed Metrics (Chooi et al., EvalEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.evaleval-1.36.pdf