Measuring Perceptions of Personhood with Semantic Proto-role Properties

Elizabeth Spaulding Hoefer, James Martin


Abstract
We show that semantic proto-role properties can be used as a tool to measure implicit human perceptions of agency and patiency of entities in human-generated text. First, we demonstrate that silver-generated semantic proto-role property labels are strongly correlated with both human judgment and a probabilistic text-based measure of anthropomorphism. Then, we use our measure to quantify linguistic idiosyncrasies across different AI-related Reddit communities. Our measure shows that subreddits dedicated to discussing AI companionship ascribe higher sentience to "bots" and higher agency to "companies" when compared to other subreddits. This phenomenon reveals not only the unique way in which chatbots are anthropomorphized in such subreddits, but also the users’ keen awareness of their power imbalance with the companies that created the chatbots.
Anthology ID:
2026.scil-main.1
Volume:
Proceedings of the Society for Computation in Linguistics 2026
Month:
July
Year:
2026
Address:
San Diego, CA
Editors:
Rob Voigt, Alex Warstadt, Naomi Feldman, Tal Linzen
Venues:
SCiL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–14
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.scil-main.1/
DOI:
Bibkey:
Cite (ACL):
Elizabeth Spaulding Hoefer and James Martin. 2026. Measuring Perceptions of Personhood with Semantic Proto-role Properties. In Proceedings of the Society for Computation in Linguistics 2026, pages 1–14, San Diego, CA. Association for Computational Linguistics.
Cite (Informal):
Measuring Perceptions of Personhood with Semantic Proto-role Properties (Hoefer & Martin, SCiL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.scil-main.1.pdf