The Hidden Language of Harm: Examining the Role of Emojis in Harmful Online Communication and Content Moderation

Yuhang Zhou, Yimin Xiao, Wei Ai, Ge Gao


Abstract
Social media platforms have become central to modern communication, yet they also harbor offensive content that challenges platform safety and inclusivity. While prior research has primarily focused on textual indicators of offense, the role of emojis, ubiquitous visual elements in online discourse, remains underexplored. Emojis, despite being rarely offensive in isolation, can acquire harmful meanings through symbolic associations, sarcasm, and contextual misuse. In this work, we systematically examine emoji contributions to offensive Twitter messages, analyzing their distribution across offense categories and how users exploit emoji ambiguity. To address this, we propose an LLM-powered, multi-step moderation pipeline that selectively replaces harmful emojis while preserving the tweet’s semantic intent. Human evaluations demonstrate that our approach effectively reduces offensiveness while preserving semantic integrity. Our analysis also reveals heterogeneous effects across offense types, offering nuanced insights for online communication and emoji moderation.
Anthology ID:
2026.nlpcss-1.19
Volume:
Proceedings of the Seventh Workshop on Natural Language Processing and Computational Social Science
Month:
July
Year:
2026
Address:
San Diego
Editors:
Dallas Card, Anjalie Field, Katherine Keith, Julia Mendelsohn
Venues:
NLP+CSS | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
322–340
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.nlpcss-1.19/
DOI:
Bibkey:
Cite (ACL):
Yuhang Zhou, Yimin Xiao, Wei Ai, and Ge Gao. 2026. The Hidden Language of Harm: Examining the Role of Emojis in Harmful Online Communication and Content Moderation. In Proceedings of the Seventh Workshop on Natural Language Processing and Computational Social Science, pages 322–340, San Diego. Association for Computational Linguistics.
Cite (Informal):
The Hidden Language of Harm: Examining the Role of Emojis in Harmful Online Communication and Content Moderation (Zhou et al., NLP+CSS 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.nlpcss-1.19.pdf