Beyond Words: Deep Learning for Multiword Expressions and Collocations

Valia Kordoni


Abstract
Deep learning has recently shown much promise for NLP applications. Traditionally, in most NLP approaches, documents or sentences are represented by a sparse bag-of-words representation. There is now a lot of work which goes beyond this by adopting a distributed representation of words, by constructing a so-called ``neural embedding'' or vector space representation of each word or document. The aim of this tutorial is to go beyond the learning of word vectors and present methods for learning vector representations for Multiword Expressions and bilingual phrase pairs, all of which are useful for various NLP applications.This tutorial aims to provide attendees with a clear notion of the linguistic and distributional characteristics of Multiword Expressions (MWEs), their relevance for the intersection of deep learning and natural language processing, what methods and resources are available to support their use, and what more could be done in the future. Our target audience are researchers and practitioners in machine learning, parsing (syntactic and semantic) and language technology, not necessarily experts in MWEs, who are interested in tasks that involve or could benefit from considering MWEs as a pervasive phenomenon in human language and communication.
Anthology ID:
P17-5005
Volume:
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts
Month:
July
Year:
2017
Address:
Vancouver, Canada
Editors:
Maja Popović, Jordan Boyd-Graber
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
15–16
Language:
URL:
https://aclanthology.org/P17-5005
DOI:
Bibkey:
Cite (ACL):
Valia Kordoni. 2017. Beyond Words: Deep Learning for Multiword Expressions and Collocations. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts, pages 15–16, Vancouver, Canada. Association for Computational Linguistics.
Cite (Informal):
Beyond Words: Deep Learning for Multiword Expressions and Collocations (Kordoni, ACL 2017)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-1/P17-5005.pdf