Melanie McGrath
2025
A Dataset and Benchmark on Extraction of Novel Concepts on Trust in AI from Scientific Literature
Melanie McGrath
|
Harrison Bailey
|
Necva Bölücü
|
Xiang Dai
|
Sarvnaz Karimi
|
Andreas Duenser
|
Cécile Paris
Proceedings of The 23rd Annual Workshop of the Australasian Language Technology Association
This study investigates the extent to which linguistic typology influences the performance of two automatic speech recognition (ASR) systems across diverse language families. Using the FLEURS corpus and typological features from the World Atlas of Language Structures (WALS), we analysed 40 languages grouped by phonological, morphological, syntactic, and semantic domains. We evaluated two state-of-the-art multilingual ASR systems, Whisper and Seamless, to examine how their performance, measured by word error rate (WER), correlates with linguistic structures. Random Forests and Mixed Effects Models were used to quantify feature impact and statistical significance. Results reveal that while both systems leverage typological patterns, they differ in their sensitivity to specific domains. Our findings highlight how structural and functional linguistic features shape ASR performance, offering insights into model generalisability and typology-aware system development.
Search
Fix author
Co-authors
- Harrison Bailey 1
- Necva Bölücü 1
- Xiang Dai 1
- Andreas Duenser 1
- Sarvnaz Karimi 1
- show all...
Venues
- alta1