Frege in Space: A Program for Composition Distributional Semantics

Marco Baroni, Raffaella Bernardi, Roberto Zamparelli


Abstract
The lexicon of any natural language encodes a huge number of distinct word meanings. Just to understand this article, you will need to know what thousands of words mean. The space of possible sentential meanings is infinite: In this article alone, you will encounter many sentences that express ideas you have never heard before, we hope. Statistical semantics has addressed the issue of the vastness of word meaning by proposing methods to harvest meaning automatically from large collections of text (corpora). Formal semantics in the Fregean tradition has developed methods to account for the infinity of sentential meaning based on the crucial insight of compositionality, the idea that meaning of sentences is built incrementally by combining the meanings of their constituents. This article sketches a new approach to semantics that brings together ideas from statistical and formal semantics to account, in parallel, for the richness of lexical meaning and the combinatorial power of sentential semantics. We adopt, in particular, the idea that word meaning can be approximated by the patterns of co-occurrence of words in corpora from statistical semantics, and the idea that compositionality can be captured in terms of a syntax-driven calculus of function application from formal semantics.
Anthology ID:
2014.lilt-9.5
Volume:
Linguistic Issues in Language Technology, Volume 9, 2014 - Perspectives on Semantic Representations for Textual Inference
Month:
Year:
2014
Address:
Venue:
LILT
SIG:
Publisher:
CSLI Publications
Note:
Pages:
Language:
URL:
https://aclanthology.org/2014.lilt-9.5
DOI:
Bibkey:
Cite (ACL):
Marco Baroni, Raffaella Bernardi, and Roberto Zamparelli. 2014. Frege in Space: A Program for Composition Distributional Semantics. Linguistic Issues in Language Technology, 9.
Cite (Informal):
Frege in Space: A Program for Composition Distributional Semantics (Baroni et al., LILT 2014)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/2014.lilt-9.5.pdf