Nikolaos Lagos
2026
StarDrinks: An English and Korean Test Set for SLU Evaluation in a Drink Ordering Scenario
Marcely Zanon Boito | Caroline Brun | Inyoung Kim | Denys M. PROUX | Salah Ait-Mokhtar | Nikolaos Lagos | Jean-Luc Meunier | Ioan Calapodescu
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Marcely Zanon Boito | Caroline Brun | Inyoung Kim | Denys M. PROUX | Salah Ait-Mokhtar | Nikolaos Lagos | Jean-Luc Meunier | Ioan Calapodescu
Proceedings of the Fifteenth Language Resources and Evaluation Conference
LLMs and speech assistants are increasingly used for task-oriented interactions, yet their evaluation often relies on controlled scenarios that fail to capture the variability and complexity of real user requests. Drink ordering, for example, involves diverse named entities, drink types, sizes, customizations, and brand-specific terminology, as well as spontaneous speech phenomena such as hesitations and self-corrections. To address this gap, we introduce StarDrinks, a test set in English and Korean containing speech utterances features, transcriptions, and annotated slots. Our dataset supports speech-to-slots SLU, transcription-to-slots NLU, and speech-to-transcription ASR evaluation, providing a realistic benchmark for model robustness and generalization in a linguistically rich, real-world task.
2012
Adaptation of Statistical Machine Translation Model for Cross-Lingual Information Retrieval in a Service Context
Vassilina Nikoulina | Bogomil Kovachev | Nikolaos Lagos | Christof Monz
Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
Vassilina Nikoulina | Bogomil Kovachev | Nikolaos Lagos | Christof Monz
Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics