Segmentation Fault at SemEval-2026 Task 13: A Regularization-First Approach with Generator-Based Out-of-Distribution Splits for Detecting AI-Generated Code
Lakshmi Priya Swaminatha Rao, Dhannya Santhakumari Madhavan, Sreya Kodeswaran, Nithila R, Kanmani R
Abstract
This paper describes our submission to SemEval-2026 Task 13 (Subtask A) on detecting AI-generated code. We fine-tune CodeBERT-base using a generator-aware out-of-distribution (OOD) validation split to better simulate unseen test generators. Strong regularization techniques, including stochastic data augmentation, dropout, weight decay, and label smoothing, are applied to prevent overfitting to generator-specific patterns. Experiments with logistic regression, UniXcoder, and vanilla CodeBERT reveal that evaluation design has a larger impact on generalization than model scale or training data volume. Our final system achieves a macro F1 score of 0.439 on the hidden test set, representing a 62% relative improvement over unregularized baselines.- Anthology ID:
- 2026.semeval-1.266
- Volume:
- Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
- Venues:
- SemEval | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2108–2113
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.266/
- DOI:
- Cite (ACL):
- Lakshmi Priya Swaminatha Rao, Dhannya Santhakumari Madhavan, Sreya Kodeswaran, Nithila R, and Kanmani R. 2026. Segmentation Fault at SemEval-2026 Task 13: A Regularization-First Approach with Generator-Based Out-of-Distribution Splits for Detecting AI-Generated Code. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2108–2113, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- Segmentation Fault at SemEval-2026 Task 13: A Regularization-First Approach with Generator-Based Out-of-Distribution Splits for Detecting AI-Generated Code (Swaminatha Rao et al., SemEval 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.266.pdf