Beyond Citations: Integrating Finding-Based Relations for Improved Biomedical Article Representations

Yuan Liang, Massimo Poesio, Roonak Rezvani


Abstract
High-quality scientific article embeddings are essential for tasks like document retrieval, citation recommendation, and classification. Traditional citation-based approaches assume citations reflect semantic similarity—an assumption that introduces bias and noise. Recent models like SciNCL and SPECTER2 have attempted to refine citation-based representations but still struggle with noisy citation edges and fail to fully leverage textual information. To address these limitations, we propose a hybrid approach that combines Finding-Citation Graphs (FCG) with contrastive learning. Our method improves triplet selection by filtering out less important citations and incorporating finding similarity relations, leading to better semantic relationship capture. Evaluated on the SciRepEval benchmark, our approach consistently outperforms citation-only baselines, showing the value of text-based semantic structures. While we do not surpass state-of-the-art models in most tasks, our results reveal the limitations of purely citation-based embeddings and suggest paths for improvement through enhanced semantic integration and domain-specific adaptations.
Anthology ID:
2025.bionlp-1.25
Volume:
ACL 2025
Month:
August
Year:
2025
Address:
Viena, Austria
Editors:
Dina Demner-Fushman, Sophia Ananiadou, Makoto Miwa, Junichi Tsujii
Venues:
BioNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
297–306
Language:
URL:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.bionlp-1.25/
DOI:
Bibkey:
Cite (ACL):
Yuan Liang, Massimo Poesio, and Roonak Rezvani. 2025. Beyond Citations: Integrating Finding-Based Relations for Improved Biomedical Article Representations. In ACL 2025, pages 297–306, Viena, Austria. Association for Computational Linguistics.
Cite (Informal):
Beyond Citations: Integrating Finding-Based Relations for Improved Biomedical Article Representations (Liang et al., BioNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.bionlp-1.25.pdf
Supplementarymaterial:
 2025.bionlp-1.25.SupplementaryMaterial.txt