AI Agents for the Science of Science: A Survey of Tasks, Architectures, Evaluations, and Challenges

Yixuan Liu, Yicheng Zhang


Abstract
The Science of Science (SciSci) examines how scientific knowledge is generated, evaluated, and transformed by utilizing large-scale scholarly and bibliometric data. As these data grow in scale and complexity, analysis has increasingly relied on statistical, network-based, machine learning methods, and is now seeing growing involvement of AI agents. This emerging class of such agents, ranging from multi-agent simulations of scientific behavior to tool-augmented systems for empirical analysis, is beginning to reshape how SciSci research is conducted. In this survey, we propose a task-centered taxonomy, distinguishing *agents as simulations*, which model citation, collaboration, and community dynamics, from *agents as tools*, which assist empirical analysis and scientific workflows. We review agent architectures, learning mechanisms, evaluation, and SciSci benchmarks, and examine open challenges related to reliability, data quality, and bias. Our survey aims to clarify the landscape of AI agents in SciSci and to support the development of reliable and scientifically useful AI systems for studying science and scientific communities.
Anthology ID:
2026.findings-acl.1804
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
36196–36211
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.findings-acl.1804/
DOI:
Bibkey:
Cite (ACL):
Yixuan Liu and Yicheng Zhang. 2026. AI Agents for the Science of Science: A Survey of Tasks, Architectures, Evaluations, and Challenges. In Findings of the Association for Computational Linguistics: ACL 2026, pages 36196–36211, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
AI Agents for the Science of Science: A Survey of Tasks, Architectures, Evaluations, and Challenges (Liu & Zhang, Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.findings-acl.1804.pdf
Checklist:
 2026.findings-acl.1804.checklist.pdf