UMUTeam at SemEval-2026 Task 6: Soft-Voting Transformer Ensembles for Detecting and Classifying Response Ambiguity in Political Discourse

Tomás Bernal-Beltrán, Ronghao Pan, Jorge Gómez-Navalón, José Antonio García-Díaz, Rafael Valencia-Garcia


Abstract
Political discourse frequently involves strategically ambiguous responses, particularly in high-stakes settings such as presidential debates and interviews. Detecting whether a politician has directly answered a question, provided an ambiguous reply or issued a clear non-reply remains a challenging task due to the pragmatic and rhetorical nature of political language. This paper describes our participation in the SemEval 2026 CLARITY shared task on response ambiguity detection and classification in English. We focused exclusively on Task 1 (Clarity-level Classification) and proposed a weighted soft-voting ensemble that combines four fine-tuned encoder-only transformer models: RoBERTa-large, BERT-large-cased, DistilBERT-cased and ModernBERT-large. Each model was optimized through grid search and their predicted class probability distributions were aggregated using a weighted linear combination. On the official test set, our system achieved a macro-F1 score of 0.71, ranking 26th out of 41 participating teams. Even with the performance gap compared to top-ranked systems, our results demonstrate that a lightweight set of moderately sized encoder models can provide stable and competitive performance without relying on external data or large-scale architectures.
Anthology ID:
2026.semeval-1.68
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
475–482
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.68/
DOI:
Bibkey:
Cite (ACL):
Tomás Bernal-Beltrán, Ronghao Pan, Jorge Gómez-Navalón, José Antonio García-Díaz, and Rafael Valencia-Garcia. 2026. UMUTeam at SemEval-2026 Task 6: Soft-Voting Transformer Ensembles for Detecting and Classifying Response Ambiguity in Political Discourse. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 475–482, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
UMUTeam at SemEval-2026 Task 6: Soft-Voting Transformer Ensembles for Detecting and Classifying Response Ambiguity in Political Discourse (Bernal-Beltrán et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.68.pdf
Supplementarymaterial:
 2026.semeval-1.68.SupplementaryMaterial.zip
Supplementarymaterial:
 2026.semeval-1.68.SupplementaryMaterial.zip