@inproceedings{chan-etal-2024-hate,
    title = "``Is Hate Lost in Translation?'': Evaluation of Multilingual {LGBTQIA}+ Hate Speech Detection",
    author = "Chan, Fai Leui  and
      Nguyen, Duke  and
      Joshi, Aditya",
    editor = "Baldwin, Tim  and
      Rodr{\'i}guez M{\'e}ndez, Sergio Jos{\'e}  and
      Kuo, Nicholas",
    booktitle = "Proceedings of the 22nd Annual Workshop of the Australasian Language Technology Association",
    month = dec,
    year = "2024",
    address = "Canberra, Australia",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/fix-sig-urls/2024.alta-1.11/",
    pages = "146--152",
    abstract = "This paper explores the challenges of detecting LGBTQIA+ hate speech of large language models across multiple languages, including English, Italian, Chinese and (code-mixed) English-Tamil, examining the impact of machine translation and whether the nuances of hate speech are preserved across translation. We examine the hate speech detection ability of zero-shot and fine-tuned GPT. Our findings indicate that: (1) English has the highest performance and the code-mixing scenario of English-Tamil being the lowest, (2) fine-tuning improves performance consistently across languages whilst translation yields mixed results. Through simple experimentation with original text and machine-translated text for hate speech detection along with a qualitative error analysis, this paper sheds light on the socio-cultural nuances and complexities of languages that may not be captured by automatic translation."
}