Posterior-regularized REINFORCE for Instance Selection in Distant Supervision

Qi Zhang, Siliang Tang, Xiang Ren, Fei Wu, Shiliang Pu, Yueting Zhuang

Abstract
This paper provides a new way to improve the efficiency of the REINFORCE training process. We apply it to the task of instance selection in distant supervision. Modeling the instance selection in one bag as a sequential decision process, a reinforcement learning agent is trained to determine whether an instance is valuable or not and construct a new bag with less noisy instances. However unbiased methods, such as REINFORCE, could usually take much time to train. This paper adopts posterior regularization (PR) to integrate some domain-specific rules in instance selection using REINFORCE. As the experiment results show, this method remarkably improves the performance of the relation classifier trained on cleaned distant supervision dataset as well as the efficiency of the REINFORCE training.
Anthology ID:
N19-1290
Volume:
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2831–2835
Language:
URL:
https://aclanthology.org/N19-1290
DOI:
10.18653/v1/N19-1290
Bibkey:
Cite (ACL):
Qi Zhang, Siliang Tang, Xiang Ren, Fei Wu, Shiliang Pu, and Yueting Zhuang. 2019. Posterior-regularized REINFORCE for Instance Selection in Distant Supervision. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 2831–2835, Minneapolis, Minnesota. Association for Computational Linguistics.
Cite (Informal):
Posterior-regularized REINFORCE for Instance Selection in Distant Supervision (Zhang et al., NAACL 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/N19-1290.pdf
PDF Search