RIGOURATE: Quantifying Scientific Exaggeration with Evidence-Aligned Claim Evaluation

Joseph James, Chenghao Xiao, Yucheng Li, Nafise Sadat Moosavi, Chenghua Lin


Abstract
Scientific rigour tends to be sidelined in favour of bold statements, leading authors to overstate claims beyond what their results support. We present RIGOURATE, a two-stage multimodal framework that retrieves supporting evidence from a paper’s body and assigns each claim an overstatement score. The framework consists of a dataset of over 10K claim–evidence sets from ICLR and NeurIPS papers, annotated using eight LLMs, with overstatement scores calibrated using peer-review comments and validated through human evaluation. It employes a fine-tuned reranker for evidence retrieval and a fine-tuned model to predict overstatement scores with justification. Compared to strong baselines, RIGOURATE enables improved evidence retrieval and overstatement detection. Overall, our work operationalises evidential proportionality and supports clearer, more transparent scientific communication.
Anthology ID:
2026.findings-acl.1699
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
34022–34043
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1699/
DOI:
Bibkey:
Cite (ACL):
Joseph James, Chenghao Xiao, Yucheng Li, Nafise Sadat Moosavi, and Chenghua Lin. 2026. RIGOURATE: Quantifying Scientific Exaggeration with Evidence-Aligned Claim Evaluation. In Findings of the Association for Computational Linguistics: ACL 2026, pages 34022–34043, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
RIGOURATE: Quantifying Scientific Exaggeration with Evidence-Aligned Claim Evaluation (James et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1699.pdf
Checklist:
 2026.findings-acl.1699.checklist.pdf