DANGNT@SGU at SemEval-2026 Task 1: A Two-Stage Mistral Generator with DistilBERT Reranking for English Humor Generation

Tan Loc Nguyen, Dang Tuan Nguyen


Abstract
We describe DANGNT@SGU’s system for the English track of SemEval-2026 Task 1 (MWAHAHA), Subtask A (text-based humor generation). Our pipeline combines a two-stage QLoRA-adapted generator based on mistralai/Mistral-7B-Instruct-v0.2 with a DistilBERT reranker trained to distinguish jokes from non-jokes. The generator is first adapted on a raw joke corpus for general humor style, then further tuned on synthetic task-format instruction–response pairs for Word Inclusion and News Headlineprompts. At inference time, we generate five candidates per input, optionally enforce lexical constraints for Word Inclusion prompts, and rerank candidates with the classifier. In the official English Subtask A results, our team DANGNT@SGU obtained Elo 962 (95% CI: 926–986), ranking 13th. The system is practical, reproducible, and based entirely on open models and public data.
Anthology ID:
2026.semeval-1.375
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2986–2990
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.375/
DOI:
Bibkey:
Cite (ACL):
Tan Loc Nguyen and Dang Tuan Nguyen. 2026. DANGNT@SGU at SemEval-2026 Task 1: A Two-Stage Mistral Generator with DistilBERT Reranking for English Humor Generation. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2986–2990, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
DANGNT@SGU at SemEval-2026 Task 1: A Two-Stage Mistral Generator with DistilBERT Reranking for English Humor Generation (Nguyen & Nguyen, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.375.pdf
Supplementarymaterial:
 2026.semeval-1.375.SupplementaryMaterial.tex