HyperparameterOmens at SemEval-2026 Task 13: Various approaches to detecting machine- generated code

Dmitry Sukhotin, How Yu


Abstract
We present our systems for SemEval-2026 Task 13, built on the Droid resource suite and benchmark setting. For Subtask A (binary classification of human-written vs. machine-generated code), lexical baselines such as TF–IDF and character n-grams transferred poorly from the LeetCode training distribution to the production-code evaluation split. After correcting pipeline errors that obscured true performance and selecting stable AST features under domain shift, our final system uses 5 uncorrelated features and achieves 0.57 macro F1 on the public test set.For Subtask C (4-way authorship classification of human, AI, hybrid, and adversarial) lexical baselines performed poorly under a significant vocabulary shift. Deep semantic models proved more promising, and a per-class weighted ensemble which included these models achieved 0.57 macro F1 on the public test set
Anthology ID:
2026.semeval-1.177
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1372–1378
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.177/
DOI:
Bibkey:
Cite (ACL):
Dmitry Sukhotin and How Yu. 2026. HyperparameterOmens at SemEval-2026 Task 13: Various approaches to detecting machine- generated code. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 1372–1378, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
HyperparameterOmens at SemEval-2026 Task 13: Various approaches to detecting machine- generated code (Sukhotin & Yu, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.177.pdf
Supplementarymaterial:
 2026.semeval-1.177.SupplementaryMaterial.zip