End-to-End Reinforcement Learning for Automatic Taxonomy Induction

Yuning Mao, Xiang Ren, Jiaming Shen, Xiaotao Gu, Jiawei Han


Abstract
We present a novel end-to-end reinforcement learning approach to automatic taxonomy induction from a set of terms. While prior methods treat the problem as a two-phase task (i.e.,, detecting hypernymy pairs followed by organizing these pairs into a tree-structured hierarchy), we argue that such two-phase methods may suffer from error propagation, and cannot effectively optimize metrics that capture the holistic structure of a taxonomy. In our approach, the representations of term pairs are learned using multiple sources of information and used to determine which term to select and where to place it on the taxonomy via a policy network. All components are trained in an end-to-end manner with cumulative rewards, measured by a holistic tree metric over the training taxonomies. Experiments on two public datasets of different domains show that our approach outperforms prior state-of-the-art taxonomy induction methods up to 19.6% on ancestor F1.
Anthology ID:
P18-1229
Volume:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2018
Address:
Melbourne, Australia
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2462–2472
Language:
URL:
https://aclanthology.org/P18-1229
DOI:
10.18653/v1/P18-1229
Bibkey:
Cite (ACL):
Yuning Mao, Xiang Ren, Jiaming Shen, Xiaotao Gu, and Jiawei Han. 2018. End-to-End Reinforcement Learning for Automatic Taxonomy Induction. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2462–2472, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
End-to-End Reinforcement Learning for Automatic Taxonomy Induction (Mao et al., ACL 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp-22-attachments/P18-1229.pdf
Poster:
 P18-1229.Poster.pdf
Code
 morningmoni/TaxoRL