SemEval-2026 Task 13: Fine-tuned CodeBERT with Stratified Balancing, Dynamic Threshold Optimization, and Logit Bias Correction for Robust Multi-Language AI Code Detection

Udaythalavesh S, Rajalakshmi Sivanaiah, Angel Deborah S


Abstract
We present a CodeBERT-based system for detecting AI-generated code in SemEval-2026 Task 13 Subtask A. To address class imbalance and model overconfidence, we apply stratified balanced subsampling, dynamic per-epoch F1-macro threshold optimization, and label-flip bias correction. The model is trained using TPU-accelerated fine-tuning and achieves a validation F1-macro of 0.874 and a private leaderboard F1-macro of 0.53. Ablation studies confirm the effectiveness of our balancing and calibration strategies under distribution shift.
Anthology ID:
2026.semeval-1.132
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
958–963
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.132/
DOI:
Bibkey:
Cite (ACL):
Udaythalavesh S, Rajalakshmi Sivanaiah, and Angel Deborah S. 2026. SemEval-2026 Task 13: Fine-tuned CodeBERT with Stratified Balancing, Dynamic Threshold Optimization, and Logit Bias Correction for Robust Multi-Language AI Code Detection. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 958–963, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
SemEval-2026 Task 13: Fine-tuned CodeBERT with Stratified Balancing, Dynamic Threshold Optimization, and Logit Bias Correction for Robust Multi-Language AI Code Detection (S et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.132.pdf
Supplementarymaterial:
 2026.semeval-1.132.SupplementaryMaterial.zip