Reevaluating Argument Component Extraction in Low Resource Settings
Anirudh Joshi, Timothy Baldwin, Richard Sinnott, Cecile Paris
Abstract
Argument component extraction is a challenging and complex high-level semantic extraction task. As such, it is both expensive to annotate (meaning training data is limited and low-resource by nature), and hard for current-generation deep learning methods to model. In this paper, we reevaluate the performance of state-of-the-art approaches in both single- and multi-task learning settings using combinations of character-level, GloVe, ELMo, and BERT encodings using standard BiLSTM-CRF encoders. We use evaluation metrics that are more consistent with evaluation practice in named entity recognition to understand how well current baselines address this challenge and compare their performance to lower-level semantic tasks such as CoNLL named entity recognition. We find that performance utilizing various pre-trained representations and training methodologies often leaves a lot to be desired as it currently stands, and suggest future pathways for improvement.- Anthology ID:
- D19-6124
- Volume:
- Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019)
- Month:
- November
- Year:
- 2019
- Address:
- Hong Kong, China
- Editors:
- Colin Cherry, Greg Durrett, George Foster, Reza Haffari, Shahram Khadivi, Nanyun Peng, Xiang Ren, Swabha Swayamdipta
- Venue:
- WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 219–224
- Language:
- URL:
- https://aclanthology.org/D19-6124
- DOI:
- 10.18653/v1/D19-6124
- Cite (ACL):
- Anirudh Joshi, Timothy Baldwin, Richard Sinnott, and Cecile Paris. 2019. Reevaluating Argument Component Extraction in Low Resource Settings. In Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019), pages 219–224, Hong Kong, China. Association for Computational Linguistics.
- Cite (Informal):
- Reevaluating Argument Component Extraction in Low Resource Settings (Joshi et al., 2019)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-2/D19-6124.pdf