@inproceedings{antypas-etal-2025-sensitive,
    title = "Sensitive Content Classification in Social Media: A Holistic Resource and Evaluation",
    author = "Antypas, Dimosthenis  and
      Sen, Indira  and
      Perez Almendros, Carla  and
      Camacho-Collados, Jose  and
      Barbieri, Francesco",
    editor = "Calabrese, Agostina  and
      de Kock, Christine  and
      Nozza, Debora  and
      Plaza-del-Arco, Flor Miriam  and
      Talat, Zeerak  and
      Vargas, Francielle",
    booktitle = "Proceedings of the The 9th Workshop on Online Abuse and Harms (WOAH)",
    month = aug,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/acl25-workshop-ingestion/2025.woah-1.2/",
    pages = "17--31",
    ISBN = "979-8-89176-105-6",
    abstract = "The detection of sensitive content in large datasets is crucial for ensuring that shared and analysed data is free from harmful material. However, current moderation tools, such as external APIs, suffer from limitations in customisation, accuracy across diverse sensitive categories, and privacy concerns. Additionally, existing datasets and open-source models focus predominantly on toxic language, leaving gaps in detecting other sensitive categories such as substance abuse or self-harm. In this paper, we put forward a unified dataset tailored for social media content moderation across six sensitive categories: conflictual language, profanity,sexually explicit material, drug-related content, self-harm, and spam. By collecting and annotating data with consistent retrieval strategies and guidelines, we address the shortcomings of previous focalised research. Our analysis demonstrates that fine-tuning large language models (LLMs) on this novel dataset yields significant improvements in detection performance compared to open off-the-shelf models such as LLaMA, and even proprietary OpenAI models, which underperform by 10-15{\%} overall. This limitation is even more pronounced on popular moderation APIs, which cannot be easily tailored to specific sensitive content categories, among others."
}