Syntactic Parsing in Humans and Machines

Paola Merlo


Abstract
To process the syntactic structures of a language in ways that are compatible with human expectations, we need computational representations of lexical and syntactic properties that form the basis of human knowledge of words and sentences. Recent neural-network-based and distributed semantics techniques have developed systems of considerable practical success and impressive performance. As has been advocated by many, however, such systems still lack human-like properties. In particular, linguistic, psycholinguistic and neuroscientific investigations have shown that human processing of sentences is sensitive to structure and unbounded relations. In the spirit of better understanding the structure building and long-distance properties of neural networks, I will present an overview of recent results on agreement and island effects in syntax in several languages. While certain sets of results in the literature indicate that neural language models exhibit long-distance agreement abilities, other finer-grained investigation of how these effects are calculated indicates that that the similarity spaces they define do not correlate with human experimental results on intervention similarity in long-distance dependencies. This opens the way to reflections on how to better match the syntactic properties of natural languages in the representations of neural models.
Anthology ID:
2020.iwpt-1.1
Volume:
Proceedings of the 16th International Conference on Parsing Technologies and the IWPT 2020 Shared Task on Parsing into Enhanced Universal Dependencies
Month:
July
Year:
2020
Address:
Online
Editors:
Gosse Bouma, Yuji Matsumoto, Stephan Oepen, Kenji Sagae, Djamé Seddah, Weiwei Sun, Anders Søgaard, Reut Tsarfaty, Dan Zeman
Venue:
IWPT
SIG:
SIGPARSE
Publisher:
Association for Computational Linguistics
Note:
Pages:
1
Language:
URL:
https://aclanthology.org/2020.iwpt-1.1
DOI:
10.18653/v1/2020.iwpt-1.1
Bibkey:
Cite (ACL):
Paola Merlo. 2020. Syntactic Parsing in Humans and Machines. In Proceedings of the 16th International Conference on Parsing Technologies and the IWPT 2020 Shared Task on Parsing into Enhanced Universal Dependencies, page 1, Online. Association for Computational Linguistics.
Cite (Informal):
Syntactic Parsing in Humans and Machines (Merlo, IWPT 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-1/2020.iwpt-1.1.pdf
Video:
 http://slideslive.com/38929668