Weigh Your Own Words: Improving Hate Speech Counter Narrative Generation via Attention Regularization

Helena Bonaldi, Giuseppe Attanasio, Debora Nozza, Marco Guerini


Abstract
Recent computational approaches for combating online hate speech involve the automatic generation of counter narratives by adapting Pretrained Transformer-based Language Models (PLMs) with human-curated data. This process, however, can produce in-domain overfitting, resulting in models generating acceptable narratives only for hatred similar to training data, with little portability to other targets or to real-world toxic language. This paper introduces novel attention regularization methodologies to improve the generalization capabilities of PLMs for counter narratives generation. Overfitting to training-specific terms is then discouraged, resulting in more diverse and richer narratives. We experiment with two attention-based regularization techniques on a benchmark English dataset. Regularized models produce better counter narratives than state-of-the-art approaches in most cases, both in terms of automatic metrics and human evaluation, especially when hateful targets are not present in the training data. This work paves the way for better and more flexible counter-speech generation models, a task for which datasets are highly challenging to produce.
Anthology ID:
2023.cs4oa-1.2
Volume:
Proceedings of the 1st Workshop on CounterSpeech for Online Abuse (CS4OA)
Month:
September
Year:
2023
Address:
Prague, Czechia
Editors:
Yi-Ling Chung, Helena Bonaldi, Gavin Abercrombie, Marco Guerini
Venues:
CS4OA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13–28
Language:
URL:
https://aclanthology.org/2023.cs4oa-1.2
DOI:
Bibkey:
Cite (ACL):
Helena Bonaldi, Giuseppe Attanasio, Debora Nozza, and Marco Guerini. 2023. Weigh Your Own Words: Improving Hate Speech Counter Narrative Generation via Attention Regularization. In Proceedings of the 1st Workshop on CounterSpeech for Online Abuse (CS4OA), pages 13–28, Prague, Czechia. Association for Computational Linguistics.
Cite (Informal):
Weigh Your Own Words: Improving Hate Speech Counter Narrative Generation via Attention Regularization (Bonaldi et al., CS4OA-WS 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-1/2023.cs4oa-1.2.pdf