Data Augmentation Based on Selective Masking of Language Models for One Health Context
Youssef Mahdoubi, Najlae Idrissi, Mathieu Roche, Sarah Valentin
Abstract
This study focuses on improving the performance of language models for two critical applications within the One Health context, specifically in epidemiological monitoring using textual data: (i) thematic classification across syndromic surveillance, biomedical and plant health domains, and (ii) detection of epidemic misinformation. A key challenge in these tasks is the limited availability of labeled textual data, which constrains the effectiveness of supervised learning methods. To overcome this limitation, we introduce two families of selective masking–based data augmentation strategies: lexical and non-lexical. Each family is implemented in a standard variant (Aug-SM-Lex and Aug-SM-NonLex), and a TF-IDF-weighted variant (Aug-SM-Lex-TFIDF and Aug-SM-NonLex-TFIDF). We perform two complementary experiments: the first determines the optimal masking rate, while the second evaluates the proposed strategies against LLM-based text reformulation. Experimental results indicate that selective masking-based augmentation outperformed both LLM-based reformulation (Mistral-7B and GPT-Neo-1.3B) and baseline models trained on original data alone across three of the five evaluated datasets, with the best performance achieved at a masking rate of 20%. This suggests that selective masking is a promising approach, potentially more effective than computationally expensive LLM-based reformulation.- Anthology ID:
- 2026.healing-1.23
- Volume:
- Proceedings of the 1st Workshop on Linguistic Analysis for Health (HeaLing 2026)
- Month:
- March
- Year:
- 2026
- Address:
- Rabat, Morocco
- Editors:
- Vera Danilova, Murathan Kurfalı, Ylva Söderfeldt, Julia Reed, Andrew Burchell
- Venues:
- HeaLing | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 266–276
- Language:
- URL:
- https://preview.aclanthology.org/ingest-eacl/2026.healing-1.23/
- DOI:
- Cite (ACL):
- Youssef Mahdoubi, Najlae Idrissi, Mathieu Roche, and Sarah Valentin. 2026. Data Augmentation Based on Selective Masking of Language Models for One Health Context. In Proceedings of the 1st Workshop on Linguistic Analysis for Health (HeaLing 2026), pages 266–276, Rabat, Morocco. Association for Computational Linguistics.
- Cite (Informal):
- Data Augmentation Based on Selective Masking of Language Models for One Health Context (Mahdoubi et al., HeaLing 2026)
- PDF:
- https://preview.aclanthology.org/ingest-eacl/2026.healing-1.23.pdf