AMISCO: The Austrian German Multi-Sensor Corpus

Hannes Pessentheiner, Thomas Pichler, Martin Hagmüller


Abstract
We introduce a unique, comprehensive Austrian German multi-sensor corpus with moving and non-moving speakers to facilitate the evaluation of estimators and detectors that jointly detect a speaker’s spatial and temporal parameters. The corpus is suitable for various machine learning and signal processing tasks, linguistic studies, and studies related to a speaker’s fundamental frequency (due to recorded glottograms). Available corpora are limited to (synthetically generated/spatialized) speech data or recordings of musical instruments that lack moving speakers, glottograms, and/or multi-channel distant speech recordings. That is why we recorded 24 spatially non-moving and moving speakers, balanced male and female, to set up a two-room and 43-channel Austrian German multi-sensor speech corpus. It contains 8.2 hours of read speech based on phonetically balanced sentences, commands, and digits. The orthographic transcriptions include around 53,000 word tokens and 2,070 word types. Special features of this corpus are the laryngograph recordings (representing glottograms required to detect a speaker’s instantaneous fundamental frequency and pitch), corresponding clean-speech recordings, and spatial information and video data provided by four Kinects and a camera.
Anthology ID:
L16-1121
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
760–766
Language:
URL:
https://aclanthology.org/L16-1121
DOI:
Bibkey:
Cite (ACL):
Hannes Pessentheiner, Thomas Pichler, and Martin Hagmüller. 2016. AMISCO: The Austrian German Multi-Sensor Corpus. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 760–766, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
AMISCO: The Austrian German Multi-Sensor Corpus (Pessentheiner et al., LREC 2016)
Copy Citation:
PDF:
https://preview.aclanthology.org/nodalida-main-page/L16-1121.pdf