Different Time, Different Language: Revisiting the Bias Against Non-Native Speakers in GPT Detectors

Adnan Al Ali, Jindřich Helcl, Jindřich Libovický


Abstract
LLM-based assistants have been widely popularised after the release of ChatGPT. Concerns have been raised about their misuse in academia, given the difficulty of distinguishing between human-written and generated text. To combat this, automated techniques have been developed and shown to be effective, to some extent. However, prior work suggests that these methods often falsely flag essays from non-native speakers as generated, due to their low perplexity extracted from an LLM, which is supposedly a key feature of the detectors. We revisit these statements two years later, specifically in the Czech language setting. We show that the perplexity of texts from non-native speakers of Czech is not lower than that of native speakers. We further examine detectors from three separate families and find no systematic bias against non-native speakers. Finally, we demonstrate that contemporary detectors operate effectively without relying on perplexity.
Anthology ID:
2026.eacl-srw.20
Volume:
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 4: Student Research Workshop)
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Selene Baez Santamaria, Sai Ashish Somayajula, Atsuki Yamaguchi
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
277–291
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-srw.20/
DOI:
Bibkey:
Cite (ACL):
Adnan Al Ali, Jindřich Helcl, and Jindřich Libovický. 2026. Different Time, Different Language: Revisiting the Bias Against Non-Native Speakers in GPT Detectors. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 4: Student Research Workshop), pages 277–291, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
Different Time, Different Language: Revisiting the Bias Against Non-Native Speakers in GPT Detectors (Al Ali et al., EACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-srw.20.pdf