Deep Reinforcement Learning for Chinese Zero Pronoun Resolution

Qingyu Yin, Yu Zhang, Wei-Nan Zhang, Ting Liu, William Yang Wang


Abstract
Recent neural network models for Chinese zero pronoun resolution gain great performance by capturing semantic information for zero pronouns and candidate antecedents, but tend to be short-sighted, operating solely by making local decisions. They typically predict coreference links between the zero pronoun and one single candidate antecedent at a time while ignoring their influence on future decisions. Ideally, modeling useful information of preceding potential antecedents is crucial for classifying later zero pronoun-candidate antecedent pairs, a need which leads traditional models of zero pronoun resolution to draw on reinforcement learning. In this paper, we show how to integrate these goals, applying deep reinforcement learning to deal with the task. With the help of the reinforcement learning agent, our system learns the policy of selecting antecedents in a sequential manner, where useful information provided by earlier predicted antecedents could be utilized for making later coreference decisions. Experimental results on OntoNotes 5.0 show that our approach substantially outperforms the state-of-the-art methods under three experimental settings.
Anthology ID:
P18-1053
Volume:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2018
Address:
Melbourne, Australia
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
569–578
Language:
URL:
https://aclanthology.org/P18-1053
DOI:
10.18653/v1/P18-1053
Bibkey:
Cite (ACL):
Qingyu Yin, Yu Zhang, Wei-Nan Zhang, Ting Liu, and William Yang Wang. 2018. Deep Reinforcement Learning for Chinese Zero Pronoun Resolution. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 569–578, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
Deep Reinforcement Learning for Chinese Zero Pronoun Resolution (Yin et al., ACL 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/P18-1053.pdf
Poster:
 P18-1053.Poster.pdf
Code
 qyyin/Reinforce4ZP