Lexical Features Are More Vulnerable, Syntactic Features Have More Predictive Power
Jekaterina Novikova, Aparna Balagopalan, Ksenia Shkaruta, Frank Rudzicz
Abstract
Understanding the vulnerability of linguistic features extracted from noisy text is important for both developing better health text classification models and for interpreting vulnerabilities of natural language models. In this paper, we investigate how generic language characteristics, such as syntax or the lexicon, are impacted by artificial text alterations. The vulnerability of features is analysed from two perspectives: (1) the level of feature value change, and (2) the level of change of feature predictive power as a result of text modifications. We show that lexical features are more sensitive to text modifications than syntactic ones. However, we also demonstrate that these smaller changes of syntactic features have a stronger influence on classification performance downstream, compared to the impact of changes to lexical features. Results are validated across three datasets representing different text-classification tasks, with different levels of lexical and syntactic complexity of both conversational and written language.- Anthology ID:
- D19-5556
- Volume:
- Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019)
- Month:
- November
- Year:
- 2019
- Address:
- Hong Kong, China
- Editors:
- Wei Xu, Alan Ritter, Tim Baldwin, Afshin Rahimi
- Venue:
- WNUT
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 431–443
- Language:
- URL:
- https://aclanthology.org/D19-5556
- DOI:
- 10.18653/v1/D19-5556
- Cite (ACL):
- Jekaterina Novikova, Aparna Balagopalan, Ksenia Shkaruta, and Frank Rudzicz. 2019. Lexical Features Are More Vulnerable, Syntactic Features Have More Predictive Power. In Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019), pages 431–443, Hong Kong, China. Association for Computational Linguistics.
- Cite (Informal):
- Lexical Features Are More Vulnerable, Syntactic Features Have More Predictive Power (Novikova et al., WNUT 2019)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-1/D19-5556.pdf
- Data
- IMDb Movie Reviews