Tijmen de Haan
2025
AstroMLab 5: Structured Summaries and Concept Extraction for 400,000 Astrophysics Papers
Yuan-Sen Ting
|
Alberto Accomazzi
|
Tirthankar Ghosal
|
Tuan Dung Nguyen
|
Rui Pan
|
Zechang Sun
|
Tijmen de Haan
Proceedings of the Third Workshop for Artificial Intelligence for Scientific Publications
We present a dataset of 408,590 astrophysics papers from arXiv (astro-ph), spanning 1992 through July 2025. Each paper has been processed through a multi-stage pipeline to produce: (1) structured summaries organized into six semantic sections (Background, Motivation, Methodology, Results, Interpretation, Implication), and (2) concept extraction yielding 9,999 unique concepts with detailed descriptions. The dataset contains 3.8 million paper-concept associations and includes semantic embeddings for all concepts. Comparison with traditional ADS keywords reveals that the concepts provide denser coverage and more uniform distribution, while analysis of embedding space structure demonstrates that concepts are semantically dispersed within papers—enabling discovery through multiple diverse entry points. Concept vocabulary and embeddings are publicly released at https://github.com/tingyuansen/astro-ph_knowledge_graph.
Search
Fix author
Co-authors
- Alberto Accomazzi 1
- Tirthankar Ghosal 1
- Tuan Dung Nguyen 1
- Rui Pan 1
- Zechang Sun 1
- show all...