Rating Distributions and Bayesian Inference: Enhancing Cognitive Models of Spatial Language Use

Thomas Kluth, Holger Schultheis

Abstract
We present two methods that improve the assessment of cognitive models. The first method is applicable to models computing average acceptability ratings. For these models, we propose an extension that simulates a full rating distribution (instead of average ratings) and allows generating individual ratings. Our second method enables Bayesian inference for models generating individual data. To this end, we propose to use the cross-match test (Rosenbaum, 2005) as a likelihood function. We exemplarily present both methods using cognitive models from the domain of spatial language use. For spatial language use, determining linguistic acceptability judgments of a spatial preposition for a depicted spatial relation is assumed to be a crucial process (Logan and Sadler, 1996). Existing models of this process compute an average acceptability rating. We extend the models and – based on existing data – show that the extended models allow extracting more information from the empirical data and yield more readily interpretable information about model successes and failures. Applying Bayesian inference, we find that model performance relies less on mechanisms of capturing geometrical aspects than on mapping the captured geometry to a rating interval.
Anthology ID:
W18-2807
Volume:
Proceedings of the Eight Workshop on Cognitive Aspects of Computational Language Learning and Processing
Month:
July
Year:
2018
Address:
Melbourne
Editors:
Marco Idiart, Alessandro Lenci, Thierry Poibeau, Aline Villavicencio
Venue:
CogACLL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
47–55
Language:
URL:
https://aclanthology.org/W18-2807
DOI:
10.18653/v1/W18-2807
Bibkey:
Cite (ACL):
Thomas Kluth and Holger Schultheis. 2018. Rating Distributions and Bayesian Inference: Enhancing Cognitive Models of Spatial Language Use. In Proceedings of the Eight Workshop on Cognitive Aspects of Computational Language Learning and Processing, pages 47–55, Melbourne. Association for Computational Linguistics.
Cite (Informal):
Rating Distributions and Bayesian Inference: Enhancing Cognitive Models of Spatial Language Use (Kluth & Schultheis, CogACLL 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-3/W18-2807.pdf
PDF Search