Guidelines for Whom? Rethinking AI Ethics in Resource-Constrained Migration Services

Nari Yoo, Ashley Khor, Namrata Mukhija, Aminat Adebiyi, Miri Zilka


Abstract
AI ethics guidelines for humanitarian settings have grown in number and scope. Whether they produce their intended outcomes depends on which deployers are expected to follow them. These guidelines respond to documented risks: surveillance, data misuse, and discriminatory outcomes affecting refugee populations. For high-risk applications such as biometric identification and asylum adjudication, the concerns they address are genuine. Many differentiate risk tiers in principle, yet the compliance expectations they establish (staff capacity, technical infrastructure, formal evaluation) reflect the organizational contexts in which they were developed. Many nonprofits providing frontline services to refugees operate with limited administrative capacity. When compliance requirements exceed what these organizations can meet, formal AI adoption stalls, while informal adoption proceeds without oversight or recourse. Current guidelines also tend to treat non-adoption as a neutral default, without accounting for the service gaps that follow when AI-assisted language access is unavailable. Drawing on collaboration with refugee-serving practitioners, we show that this gap between governance design and organizational reality has consequences for the people these guidelines are meant to protect. Evaluating AI guidelines, we argue, requires the same realist logic that evaluation research has long applied to social programs: not "does this guideline exist?" but "for which deployers, under what conditions, and does it produce its intended protective outcomes?"
Anthology ID:
2026.evaleval-1.3
Volume:
Proceedings of the Workshop on Evaluating Evaluations (EvalEval)
Month:
July
Year:
2026
Address:
San Diego, CA
Editors:
Mubashara Akhtar, Jan Batzner, Leshem Choshen, Avijit Ghosh, Usman Gohar, Jennifer Mickel, Ichhya Pant, Zeerak Talat, Michelle Lin
Venues:
EvalEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
19–25
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.evaleval-1.3/
DOI:
Bibkey:
Cite (ACL):
Nari Yoo, Ashley Khor, Namrata Mukhija, Aminat Adebiyi, and Miri Zilka. 2026. Guidelines for Whom? Rethinking AI Ethics in Resource-Constrained Migration Services. In Proceedings of the Workshop on Evaluating Evaluations (EvalEval), pages 19–25, San Diego, CA. Association for Computational Linguistics.
Cite (Informal):
Guidelines for Whom? Rethinking AI Ethics in Resource-Constrained Migration Services (Yoo et al., EvalEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.evaleval-1.3.pdf