A Neighborhood Framework for Resource-Lean Content Flagging
Sheikh Muhammad Sarwar, Dimitrina Zlatkova, Momchil Hardalov, Yoan Dinkov, Isabelle Augenstein, Preslav Nakov
Abstract
We propose a novel framework for cross- lingual content flagging with limited target- language data, which significantly outperforms prior work in terms of predictive performance. The framework is based on a nearest-neighbor architecture. It is a modern instantiation of the vanilla k-nearest neighbor model, as we use Transformer representations in all its components. Our framework can adapt to new source- language instances, without the need to be retrained from scratch. Unlike prior work on neighborhood-based approaches, we encode the neighborhood information based on query– neighbor interactions. We propose two encoding schemes and we show their effectiveness using both qualitative and quantitative analysis. Our evaluation results on eight languages from two different datasets for abusive language detection show sizable improvements of up to 9.5 F1 points absolute (for Italian) over strong baselines. On average, we achieve 3.6 absolute F1 points of improvement for the three languages in the Jigsaw Multilingual dataset and 2.14 points for the WUL dataset.- Anthology ID:
- 2022.tacl-1.28
- Volume:
- Transactions of the Association for Computational Linguistics, Volume 10
- Month:
- Year:
- 2022
- Address:
- Cambridge, MA
- Editors:
- Brian Roark, Ani Nenkova
- Venue:
- TACL
- SIG:
- Publisher:
- MIT Press
- Note:
- Pages:
- 484–502
- Language:
- URL:
- https://aclanthology.org/2022.tacl-1.28
- DOI:
- 10.1162/tacl_a_00472
- Cite (ACL):
- Sheikh Muhammad Sarwar, Dimitrina Zlatkova, Momchil Hardalov, Yoan Dinkov, Isabelle Augenstein, and Preslav Nakov. 2022. A Neighborhood Framework for Resource-Lean Content Flagging. Transactions of the Association for Computational Linguistics, 10:484–502.
- Cite (Informal):
- A Neighborhood Framework for Resource-Lean Content Flagging (Sarwar et al., TACL 2022)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/2022.tacl-1.28.pdf