Using Pause Information for More Accurate Entity Recognition
Sahas Dendukuri, Pooja Chitkara, Joel Ruben Antony Moniz, Xiao Yang, Manos Tsagkias, Stephen Pulman
Abstract
Entity tags in human-machine dialog are integral to natural language understanding (NLU) tasks in conversational assistants. However, current systems struggle to accurately parse spoken queries with the typical use of text input alone, and often fail to understand the user intent. Previous work in linguistics has identified a cross-language tendency for longer speech pauses surrounding nouns as compared to verbs. We demonstrate that the linguistic observation on pauses can be used to improve accuracy in machine-learnt language understanding tasks. Analysis of pauses in French and English utterances from a commercial voice assistant shows the statistically significant difference in pause duration around multi-token entity span boundaries compared to within entity spans. Additionally, in contrast to text-based NLU, we apply pause duration to enrich contextual embeddings to improve shallow parsing of entities. Results show that our proposed novel embeddings improve the relative error rate by up to 8% consistently across three domains for French, without any added annotation or alignment costs to the parser.- Anthology ID:
- 2021.nlp4convai-1.22
- Volume:
- Proceedings of the 3rd Workshop on Natural Language Processing for Conversational AI
- Month:
- November
- Year:
- 2021
- Address:
- Online
- Editors:
- Alexandros Papangelis, Paweł Budzianowski, Bing Liu, Elnaz Nouri, Abhinav Rastogi, Yun-Nung Chen
- Venue:
- NLP4ConvAI
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 243–250
- Language:
- URL:
- https://aclanthology.org/2021.nlp4convai-1.22
- DOI:
- 10.18653/v1/2021.nlp4convai-1.22
- Cite (ACL):
- Sahas Dendukuri, Pooja Chitkara, Joel Ruben Antony Moniz, Xiao Yang, Manos Tsagkias, and Stephen Pulman. 2021. Using Pause Information for More Accurate Entity Recognition. In Proceedings of the 3rd Workshop on Natural Language Processing for Conversational AI, pages 243–250, Online. Association for Computational Linguistics.
- Cite (Informal):
- Using Pause Information for More Accurate Entity Recognition (Dendukuri et al., NLP4ConvAI 2021)
- PDF:
- https://preview.aclanthology.org/dois-2013-emnlp/2021.nlp4convai-1.22.pdf