“Otherwise” in Context: Exploring Discourse Functions with Language Models

Guifu Liu, Bonnie Webber, Hannah Rohde


Abstract
Discourse adverbials are key features of discourse coherence, but their function is often ambiguous. In this work, we investigate how the discourse function of otherwise varies in different contexts. We revise the function set in Rohde et al. (2018b) to account for a new meaning we have encountered. In turn, we create the “otherwise” corpus, a dataset of naturally occurring passages annotated for discourse functions, and identify lexical signals that make a function available with a corpus study. We define continuation acceptability, a metric based on surprisal to probe language models for what they take the function of otherwise to be in a given context. Our experiments show that one can improve function inference by focusing solely on tokens up to and including the head verb of the continuation (i.e., otherwise clause) that have the most varied surprisal across function-disambiguating discourse markers. Lastly, we observe that some of these tokens confirm lexical signals we found in our earlier corpus study, which provides some promising evidence to motivate future pragmatic studies in language models
Anthology ID:
2025.codi-1.7
Volume:
Proceedings of the 6th Workshop on Computational Approaches to Discourse, Context and Document-Level Inferences (CODI 2025)
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Michael Strube, Chloe Braud, Christian Hardmeier, Junyi Jessy Li, Sharid Loaiciga, Amir Zeldes, Chuyuan Li
Venues:
CODI | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
81–95
Language:
URL:
https://preview.aclanthology.org/ingest-emnlp/2025.codi-1.7/
DOI:
Bibkey:
Cite (ACL):
Guifu Liu, Bonnie Webber, and Hannah Rohde. 2025. “Otherwise” in Context: Exploring Discourse Functions with Language Models. In Proceedings of the 6th Workshop on Computational Approaches to Discourse, Context and Document-Level Inferences (CODI 2025), pages 81–95, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
“Otherwise” in Context: Exploring Discourse Functions with Language Models (Liu et al., CODI 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-emnlp/2025.codi-1.7.pdf
Supplementarymaterial:
 2025.codi-1.7.SupplementaryMaterial.zip