Abstract
Effective methods for multiword expressions detection are important for many technologies related to Natural Language Processing. Most contemporary methods are based on the sequence labeling scheme applied to an annotated corpus, while traditional methods use statistical measures. In our approach, we want to integrate the concepts of those two approaches. We present a novel weakly supervised multiword expressions extraction method which focuses on their behaviour in various contexts. Our method uses a lexicon of English multiword lexical units acquired from The Oxford Dictionary of English as a reference knowledge base and leverages neural language modelling with deep learning architectures. In our approach, we do not need a corpus annotated specifically for the task. The only required components are: a lexicon of multiword units, a large corpus, and a general contextual embeddings model. We propose a method for building a silver dataset by spotting multiword expression occurrences and acquiring statistical collocations as negative samples. Sample representation has been inspired by representations used in Natural Language Inference and relation recognition. Very good results (F1=0.8) were obtained with CNN network applied to individual occurrences followed by weighted voting used to combine results from the whole corpus. The proposed method can be quite easily applied to other languages.- Anthology ID:
- 2022.acl-srw.36
- Volume:
- Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland
- Editors:
- Samuel Louvan, Andrea Madotto, Brielen Madureira
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 444–453
- Language:
- URL:
- https://aclanthology.org/2022.acl-srw.36
- DOI:
- 10.18653/v1/2022.acl-srw.36
- Cite (ACL):
- Kamil Kanclerz and Maciej Piasecki. 2022. Deep Neural Representations for Multiword Expressions Detection. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, pages 444–453, Dublin, Ireland. Association for Computational Linguistics.
- Cite (Informal):
- Deep Neural Representations for Multiword Expressions Detection (Kanclerz & Piasecki, ACL 2022)
- PDF:
- https://preview.aclanthology.org/naacl-24-ws-corrections/2022.acl-srw.36.pdf
- Code
- CLARIN-PL/mwe-vector-methods