A Modeling Study of the Effects of Surprisal and Entropy in Perceptual Decision Making of an Adaptive Agent
Abstract
Processing difficulty in online language comprehension has been explained in terms of surprisal and entropy reduction. Although both hypotheses have been supported by experimental data, we do not fully understand their relative contributions on processing difficulty. To develop a better understanding, we propose a mechanistic model of perceptual decision making that interacts with a simulated task environment with temporal dynamics. The proposed model collects noisy bottom-up evidence over multiple timesteps, integrates it with its top-down expectation, and makes perceptual decisions, producing processing time data directly without relying on any linking hypothesis. Temporal dynamics in the task environment was determined by a simple finite-state grammar, which was designed to create the situations where the surprisal and entropy reduction hypotheses predict different patterns. After the model was trained to maximize rewards, the model developed an adaptive policy and both surprisal and entropy effects were observed especially in a measure reflecting earlier processing.- Anthology ID:
- W19-2906
- Volume:
- Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics
- Month:
- June
- Year:
- 2019
- Address:
- Minneapolis, Minnesota
- Editors:
- Emmanuele Chersoni, Cassandra Jacobs, Alessandro Lenci, Tal Linzen, Laurent Prévot, Enrico Santus
- Venue:
- CMCL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 53–61
- Language:
- URL:
- https://aclanthology.org/W19-2906
- DOI:
- 10.18653/v1/W19-2906
- Cite (ACL):
- Pyeong Whan Cho and Richard Lewis. 2019. A Modeling Study of the Effects of Surprisal and Entropy in Perceptual Decision Making of an Adaptive Agent. In Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, pages 53–61, Minneapolis, Minnesota. Association for Computational Linguistics.
- Cite (Informal):
- A Modeling Study of the Effects of Surprisal and Entropy in Perceptual Decision Making of an Adaptive Agent (Cho & Lewis, CMCL 2019)
- PDF:
- https://preview.aclanthology.org/teach-a-man-to-fish/W19-2906.pdf