Who Wrote This? Identifying Machine vs Human-Generated Text in Hausa
Babangida Sani, Aakansha Soy, Sukairaj Hafiz Imam, Ahmad Mustapha, Lukman Jibril Aliyu, Idris Abdulmumin, Ibrahim Said Ahmad, Shamsuddeen Hassan Muhammad
Abstract
The advancement of large language models (LLMs) has allowed them to be proficient in various tasks, including content generation. However, their unregulated usage can lead to malicious activities such as plagiarism and generating and spreading fake news, especially for low-resource languages. Most existing machine-generated text detectors are trained on high-resource languages like English, French, etc. In this study, we developed the first large-scale detector that can distinguish between human- and machine-generated content in Hausa. We scraped seven Hausa-language media outlets for the human-generated text and the Gemini-2.0 flash model to automatically generate the corresponding Hausa-language articles based on the human-generated article headlines. We fine-tuned four pre-trained African-centric models (AfriTeVa, AfriBERTa, AfroX LMR, and AfroXLMR-76L) on the resulting dataset and assessed their performance using accuracy and F1-score metrics. AfroXLMR achieved the highest performance with an accuracy of 99.23% and an F1 score of 99.21%, demonstrating its effectiveness for Hausa text detection. Our dataset is made publicly available to enable further research.- Anthology ID:
- 2025.africanlp-1.12
- Volume:
- Proceedings of the Sixth Workshop on African Natural Language Processing (AfricaNLP 2025)
- Month:
- July
- Year:
- 2025
- Address:
- Vienna, Austria
- Editors:
- Constantine Lignos, Idris Abdulmumin, David Adelani
- Venues:
- AfricaNLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 82–88
- Language:
- URL:
- https://preview.aclanthology.org/acl25-workshop-ingestion/2025.africanlp-1.12/
- DOI:
- Cite (ACL):
- Babangida Sani, Aakansha Soy, Sukairaj Hafiz Imam, Ahmad Mustapha, Lukman Jibril Aliyu, Idris Abdulmumin, Ibrahim Said Ahmad, and Shamsuddeen Hassan Muhammad. 2025. Who Wrote This? Identifying Machine vs Human-Generated Text in Hausa. In Proceedings of the Sixth Workshop on African Natural Language Processing (AfricaNLP 2025), pages 82–88, Vienna, Austria. Association for Computational Linguistics.
- Cite (Informal):
- Who Wrote This? Identifying Machine vs Human-Generated Text in Hausa (Sani et al., AfricaNLP 2025)
- PDF:
- https://preview.aclanthology.org/acl25-workshop-ingestion/2025.africanlp-1.12.pdf