AI4PC-Howard University at SemEval-2026 Task 2: Fine-Tuning DistilBERT, DeBERTa and ModernBERT for Valence–Arousal Prediction and Change Estimation

Araj Shah, Utsav Shah, Saurav Aryal


Abstract
We present lightweight, reproducible models for longitudinal valence–arousal (VA) prediction in the SemEval-2026 Task 2 essay corpus. Using only the official data, we enforce user-disjoint splits to prevent leakage and evaluate three settings: essay-level VA state estimation, short-horizon VA change forecasting, and long-horizon disposition change prediction. Our submitted systems use DistilBERT for essay-level regression, ModernBERT-based history modeling with a GRU and a blended previous-delta baseline for short-horizon change, and pooled DeBERTa history embeddings with a compact MLP for disposition change. On the official evaluation, across our best performing approaches, we achieve rcomp =0.665/0.468 (valence/arousal) for Subtask 1, r = 0.597/0.413 for Subtask 2A, and r =0.046/0.348 for Subtask 2B.
Anthology ID:
2026.semeval-1.89
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
617–623
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.89/
DOI:
Bibkey:
Cite (ACL):
Araj Shah, Utsav Shah, and Saurav Aryal. 2026. AI4PC-Howard University at SemEval-2026 Task 2: Fine-Tuning DistilBERT, DeBERTa and ModernBERT for Valence–Arousal Prediction and Change Estimation. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 617–623, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
AI4PC-Howard University at SemEval-2026 Task 2: Fine-Tuning DistilBERT, DeBERTa and ModernBERT for Valence–Arousal Prediction and Change Estimation (Shah et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.89.pdf