Understanding the Linguistic Cues Behind Stance Detection

Parush Gera, Tempestt Neal


Abstract
Stance detection seeks to determine whether a text expresses a position in favor of, against, or neutral toward a target. Despite advances in neural architectures, performance remains inconsistent across datasets. To better understand these disparities, we analyze over 75K samples from four benchmark datasets using six neural models, focusing on stylistic and pragmatic language features rather than architectures or external knowledge. We extract 43 features spanning lexical richness, syntactic complexity, affective tone, and hedging, and assess their impact through both Logistic Regression and SHAP analyses. Our findings reveal distinct stylistic profiles for each stance: favor is best detected when expressed concisely with minimal hedging; against when paired with strong negative emotions and greater lexical variety; and none when texts are lexically simple and emotionally neutral. Across classes, errors arise from excessive complexity, mixed emotional signals, and overuse of hedging. These results advance understanding of what drives success and failure in stance detection.
Anthology ID:
2026.starsem-conference.20
Volume:
Proceedings of the 15th Joint Conference on Lexical and Computational Semantics (*SEM 2026)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Saif M. Mohammad, Nedjma Ousidhoum
Venues:
*SEM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
302–316
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.starsem-conference.20/
DOI:
Bibkey:
Cite (ACL):
Parush Gera and Tempestt Neal. 2026. Understanding the Linguistic Cues Behind Stance Detection. In Proceedings of the 15th Joint Conference on Lexical and Computational Semantics (*SEM 2026), pages 302–316, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Understanding the Linguistic Cues Behind Stance Detection (Gera & Neal, *SEM 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.starsem-conference.20.pdf