Out of the Box, into the Clinic? Evaluating State-of-the-Art ASR for Clinical Applications for Older Adults
Bram Van Dijk, Tiberon Kuiper, Sirin Aoulad si Ahmed, Armel Lefebvre, Jake Johnson, Jan Duin, Simon Mooijaart, Marco Spruit
Abstract
Voice-controlled interfaces can support older adults in clinical contexts – with chatbots being a prime example – but reliable Automatic Speech Recognition (ASR) for underrepresented groups remains a bottleneck. This study evaluates state-of-the-art ASR models on language use of older Dutch adults, who interacted with the Welzijn.AI chatbot designed for geriatric contexts. We benchmark generic multilingual ASR models, and models fine-tuned for Dutch spoken by older adults, while also considering processing speed. Our results show that generic multilingual models outperform fine-tuned models, which suggests recent ASR models can generalise well out of the box to real-world datasets. Moreover, our results indicate that truncating generic models is helpful in balancing the accuracy-speed trade-off. Nonetheless, we also find inputs which cause a high word error rate and place them in context.- Anthology ID:
- 2025.hcinlp-1.7
- Volume:
- Proceedings of the Fourth Workshop on Bridging Human-Computer Interaction and Natural Language Processing (HCI+NLP)
- Month:
- November
- Year:
- 2025
- Address:
- Suzhou, China
- Editors:
- Su Lin Blodgett, Amanda Cercas Curry, Sunipa Dev, Siyan Li, Michael Madaio, Jack Wang, Sherry Tongshuang Wu, Ziang Xiao, Diyi Yang
- Venues:
- HCINLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 72–78
- Language:
- URL:
- https://preview.aclanthology.org/ingest-emnlp/2025.hcinlp-1.7/
- DOI:
- Cite (ACL):
- Bram Van Dijk, Tiberon Kuiper, Sirin Aoulad si Ahmed, Armel Lefebvre, Jake Johnson, Jan Duin, Simon Mooijaart, and Marco Spruit. 2025. Out of the Box, into the Clinic? Evaluating State-of-the-Art ASR for Clinical Applications for Older Adults. In Proceedings of the Fourth Workshop on Bridging Human-Computer Interaction and Natural Language Processing (HCI+NLP), pages 72–78, Suzhou, China. Association for Computational Linguistics.
- Cite (Informal):
- Out of the Box, into the Clinic? Evaluating State-of-the-Art ASR for Clinical Applications for Older Adults (Van Dijk et al., HCINLP 2025)
- PDF:
- https://preview.aclanthology.org/ingest-emnlp/2025.hcinlp-1.7.pdf