Dual Attention Model for Citation Recommendation

Yang Zhang, Qiang Ma


Abstract
Based on an exponentially increasing number of academic articles, discovering and citing comprehensive and appropriate resources has become a non-trivial task. Conventional citation recommender methods suffer from severe information loss. For example, they do not consider the section of the paper that the user is writing and for which they need to find a citation, the relatedness between the words in the local context (the text span that describes a citation), or the importance on each word from the local context. These shortcomings make such methods insufficient for recommending adequate citations to academic manuscripts. In this study, we propose a novel embedding-based neural network called “dual attention model for citation recommendation (DACR)” to recommend citations during manuscript preparation. Our method adapts embedding of three semantic information: words in the local context, structural contexts, and the section on which a user is working. A neural network model is designed to maximize the similarity between the embedding of the three input (local context words, section and structural contexts) and the target citation appearing in the context. The core of the neural network model is composed of self-attention and additive attention, where the former aims to capture the relatedness between the contextual words and structural context, and the latter aims to learn the importance of them. The experiments on real-world datasets demonstrate the effectiveness of the proposed approach.
Anthology ID:
2020.coling-main.283
Original:
2020.coling-main.283v1
Version 2:
2020.coling-main.283v2
Version 3:
2020.coling-main.283v3
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
3179–3189
Language:
URL:
https://aclanthology.org/2020.coling-main.283
DOI:
10.18653/v1/2020.coling-main.283
Bibkey:
Cite (ACL):
Yang Zhang and Qiang Ma. 2020. Dual Attention Model for Citation Recommendation. In Proceedings of the 28th International Conference on Computational Linguistics, pages 3179–3189, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
Dual Attention Model for Citation Recommendation (Zhang & Ma, COLING 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/2020.coling-main.283.pdf