Exploring Supervised Approaches to the Detection of Anthropomorphic Language in the Reporting of NLP Venues

Matthew Shardlow, Ashley Williams, Charlie Roadhouse, Filippos Ventirozos, Piotr Przybyła


Abstract
We investigate the prevalence of anthropomorphic language in the reporting of AI technology, focussed on NLP and LLMs. We undertake a corpus annotation focussing on one year of ACL long-paper abstracts and news articles from the same period. We find that 74% of ACL abstracts and 88% of news articles contain some form of anthropomorphic description of AI technology. Further, we train a regression classifier based on BERT, demonstrating that we can automatically label abstracts for their degree of anthropomorphism based on our corpus. We conclude by applying this labelling process to abstracts available in the entire history of the ACL Anthology and reporting on diachronic and inter-venue findings, showing that the degree of anthropomorphism is increasing at all examined venues over time.
Anthology ID:
2025.findings-acl.926
Volume:
Findings of the Association for Computational Linguistics: ACL 2025
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venues:
Findings | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
18010–18022
Language:
URL:
https://preview.aclanthology.org/ingestion-acl-25/2025.findings-acl.926/
DOI:
Bibkey:
Cite (ACL):
Matthew Shardlow, Ashley Williams, Charlie Roadhouse, Filippos Ventirozos, and Piotr Przybyła. 2025. Exploring Supervised Approaches to the Detection of Anthropomorphic Language in the Reporting of NLP Venues. In Findings of the Association for Computational Linguistics: ACL 2025, pages 18010–18022, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Exploring Supervised Approaches to the Detection of Anthropomorphic Language in the Reporting of NLP Venues (Shardlow et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-acl-25/2025.findings-acl.926.pdf