Abstract
Text anomaly detection (TAD) is a crucial task that aims to identify texts that deviate significantly from the norm within a corpus. Despite its importance in various domains, TAD remains relatively underexplored in natural language processing. This article presents a systematic evaluation of 22 TAD algorithms on 17 corpora using multiple text representations, including monolingual and multilingual SBERT. The performance of the algorithms is compared based on three criteria: degree of supervision, theoretical basis, and architecture used. The results demonstrate that semi-supervised methods utilizing weak labels outperform both unsupervised methods and semi-supervised methods using only negative samples for training. Additionally, we explore the application of TAD techniques in hate speech detection. The results provide valuable insights for future TAD research and guide the selection of suitable algorithms for detecting text anomalies in different contexts.- Anthology ID:
- 2023.ranlp-1.131
- Volume:
- Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing
- Month:
- September
- Year:
- 2023
- Address:
- Varna, Bulgaria
- Editors:
- Ruslan Mitkov, Galia Angelova
- Venue:
- RANLP
- SIG:
- Publisher:
- INCOMA Ltd., Shoumen, Bulgaria
- Note:
- Pages:
- 1234–1245
- Language:
- URL:
- https://aclanthology.org/2023.ranlp-1.131
- DOI:
- Cite (ACL):
- Yizhou Xu, Kata Gábor, Jérôme Milleret, and Frédérique Segond. 2023. Comparative Analysis of Anomaly Detection Algorithms in Text Data. In Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing, pages 1234–1245, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
- Cite (Informal):
- Comparative Analysis of Anomaly Detection Algorithms in Text Data (Xu et al., RANLP 2023)
- PDF:
- https://preview.aclanthology.org/landing_page/2023.ranlp-1.131.pdf