@inproceedings{atil-etal-2025-llms,
    title = "Can {LLM}s Rank the Harmfulness of Smaller {LLM}s? We are Not There Yet",
    author = "Atil, Berk  and
      Gupta, Vipul  and
      Das, Sarkar Snigdha Sarathi  and
      Passonneau, Rebecca",
    editor = "Calabrese, Agostina  and
      de Kock, Christine  and
      Nozza, Debora  and
      Plaza-del-Arco, Flor Miriam  and
      Talat, Zeerak  and
      Vargas, Francielle",
    booktitle = "Proceedings of the The 9th Workshop on Online Abuse and Harms (WOAH)",
    month = aug,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/landing_page/2025.woah-1.30/",
    pages = "342--354",
    ISBN = "979-8-89176-105-6",
    abstract = "Large language models (LLMs) have become ubiquitous, thus it is important to understand their risks and limitations, such as their propensity to generate harmful output. This includes smaller LLMs, which are important for settings with constrained compute resources, such as edge devices. Detection of LLM harm typically requires human annotation, which is expensive to collect. This work studies two questions: How do smaller LLMs rank regarding generation of harmful content? How well can larger LLMs annotate harmfulness? We prompt three small LLMs to elicit harmful content of various types, such as discriminatory language, offensive content, privacy invasion, or negative influence, and collect human rankings of their outputs. Then, we compare harm annotation from three state-of-the-art large LLMs with each other and with humans. We find that the smaller models differ with respect to harmfulness. We also find that large LLMs show low to moderate agreement with humans."
}