Melanie McGrath


2025

pdf bib
A Dataset and Benchmark on Extraction of Novel Concepts on Trust in AI from Scientific Literature
Melanie McGrath | Harrison Bailey | Necva Bölücü | Xiang Dai | Sarvnaz Karimi | Andreas Duenser | Cécile Paris
Proceedings of The 23rd Annual Workshop of the Australasian Language Technology Association

This study investigates the extent to which linguistic typology influences the performance of two automatic speech recognition (ASR) systems across diverse language families. Using the FLEURS corpus and typological features from the World Atlas of Language Structures (WALS), we analysed 40 languages grouped by phonological, morphological, syntactic, and semantic domains. We evaluated two state-of-the-art multilingual ASR systems, Whisper and Seamless, to examine how their performance, measured by word error rate (WER), correlates with linguistic structures. Random Forests and Mixed Effects Models were used to quantify feature impact and statistical significance. Results reveal that while both systems leverage typological patterns, they differ in their sensitivity to specific domains. Our findings highlight how structural and functional linguistic features shape ASR performance, offering insights into model generalisability and typology-aware system development.