Seed Words Based Data Selection for Language Model Adaptation

Roberto Gretter, Marco Matassoni, Daniele Falavigna


Abstract
We address the problem of language model customization in applications where the ASR component needs to manage domain-specific terminology; although current state-of-the-art speech recognition technology provides excellent results for generic domains, the adaptation to specialized dictionaries or glossaries is still an open issue. In this work we present an approach for automatically selecting sentences, from a text corpus, that match, both semantically and morphologically, a glossary of terms (words or composite words) furnished by the user. The final goal is to rapidly adapt the language model of an hybrid ASR system with a limited amount of in-domain text data in order to successfully cope with the linguistic domain at hand; the vocabulary of the baseline model is expanded and tailored, reducing the resulting OOV rate. Data selection strategies based on shallow morphological seeds and semantic similarity via word2vec are introduced and discussed; the experimental setting consists in a simultaneous interpreting scenario, where ASRs in three languages are designed to recognize the domainspecific terms (i.e. dentistry). Results using different metrics (OOV rate, WER, precision and recall) show the effectiveness of the proposed techniques.
Anthology ID:
2021.mtsummit-asltrw.1
Volume:
Proceedings of the 1st Workshop on Automatic Spoken Language Translation in Real-World Settings (ASLTRW)
Month:
August
Year:
2021
Address:
Virtual
Venue:
MTSummit
SIG:
Publisher:
Association for Machine Translation in the Americas
Note:
Pages:
1–12
Language:
URL:
https://aclanthology.org/2021.mtsummit-asltrw.1
DOI:
Bibkey:
Cite (ACL):
Roberto Gretter, Marco Matassoni, and Daniele Falavigna. 2021. Seed Words Based Data Selection for Language Model Adaptation. In Proceedings of the 1st Workshop on Automatic Spoken Language Translation in Real-World Settings (ASLTRW), pages 1–12, Virtual. Association for Machine Translation in the Americas.
Cite (Informal):
Seed Words Based Data Selection for Language Model Adaptation (Gretter et al., MTSummit 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/2021.mtsummit-asltrw.1.pdf