Deep Reinforcement Learning for Chinese Zero Pronoun Resolution
Qingyu Yin, Yu Zhang, Wei-Nan Zhang, Ting Liu, William Yang Wang
Abstract
Recent neural network models for Chinese zero pronoun resolution gain great performance by capturing semantic information for zero pronouns and candidate antecedents, but tend to be short-sighted, operating solely by making local decisions. They typically predict coreference links between the zero pronoun and one single candidate antecedent at a time while ignoring their influence on future decisions. Ideally, modeling useful information of preceding potential antecedents is crucial for classifying later zero pronoun-candidate antecedent pairs, a need which leads traditional models of zero pronoun resolution to draw on reinforcement learning. In this paper, we show how to integrate these goals, applying deep reinforcement learning to deal with the task. With the help of the reinforcement learning agent, our system learns the policy of selecting antecedents in a sequential manner, where useful information provided by earlier predicted antecedents could be utilized for making later coreference decisions. Experimental results on OntoNotes 5.0 show that our approach substantially outperforms the state-of-the-art methods under three experimental settings.- Anthology ID:
- P18-1053
- Volume:
- Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2018
- Address:
- Melbourne, Australia
- Editors:
- Iryna Gurevych, Yusuke Miyao
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 569–578
- Language:
- URL:
- https://aclanthology.org/P18-1053
- DOI:
- 10.18653/v1/P18-1053
- Cite (ACL):
- Qingyu Yin, Yu Zhang, Wei-Nan Zhang, Ting Liu, and William Yang Wang. 2018. Deep Reinforcement Learning for Chinese Zero Pronoun Resolution. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 569–578, Melbourne, Australia. Association for Computational Linguistics.
- Cite (Informal):
- Deep Reinforcement Learning for Chinese Zero Pronoun Resolution (Yin et al., ACL 2018)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-1/P18-1053.pdf
- Code
- qyyin/Reinforce4ZP