Karin Stromswold


2025

pdf bib
Harnessing Whisper for Prosodic Stress Analysis
Samuel S. Sohn | Sten Knutsen | Karin Stromswold
Findings of the Association for Computational Linguistics: ACL 2025

Prosody affects how people produce and understand language, yet studies of how it does so have been hindered by the lack of efficient tools for analyzing prosodic stress. We fine-tune OpenAI Whisper large-v2, a state-of-the-art speech recognition model, to recognize phrasal, lexical, and contrastive stress using a small, carefully annotated dataset. Our results show that Whisper can learn distinct, gender-specific stress patterns to achieve near-human and super-human accuracy in stress classification and transfer its learning from one type of stress to another, surpassing traditional machine learning models. Furthermore, we explore how acoustic context influences its performance and propose a novel black-box evaluation method for characterizing the decision boundaries used by Whisper for prosodic stress interpretation. These findings open new avenues for large-scale, automated prosody research. Models can be found at github.com/SSSohn/ProsodyBench.

2012

pdf bib
Computational Analysis of Referring Expressions in Narratives of Picture Books
Choonkyu Lee | Smaranda Muresan | Karin Stromswold
Proceedings of the NAACL-HLT 2012 Workshop on Computational Linguistics for Literature