REFSafE: A RAG-Enabled Framework for Predictive Risk Analysis and Automated Safety Report Generation in Mission-Critical Environments
Sanjay Das, Ran Elgedawy, Ethan Seefried, Ryan A. Burchfield, Gavin Wiggins, Dana Hewit, Sudarshan Srinivasan, Prasanna Balaprakash, Robert M. Patton, Todd Thomas, Tirthankar Ghosal
Abstract
Operational safety in mission-critical environments requires AI systems that are accurate, interpretable, and resistant to hallucination. We present an agentic Retrieval-Augmented Generation (RAG) framework, REFSafe, for grounded hazard analysis and automated safety report generation. The system integrates Large Language Models (LLMs) with structured operational data, historical incident repositories, policy documents, and external authoritative sources. Through iterative agentic reasoning, the framework retrieves, verifies, and synthesizes evidence prior to generation, enforcing citation-backed outputs with explicit source attribution (documents, links, and prior events) to ensure traceability and trust.To mitigate hallucinations and unsupported claims, all risk assessments and forecasts are constrained to retrieved evidence, with confidence signals derived from retrieval relevance and source consistency. A transparent pipeline enables subject matter experts (SMEs) to validate predictions, and provide structured feedback, forming a continuous performance calibration loop. Preliminary deployment demonstrates improved reliability in hazard detection and safety/vulnerability report generation. This work advances trustworthy, evidence-grounded AI for predictive safety intelligence in mission-critical operations.- Anthology ID:
- 2026.rag4reports-1.6
- Volume:
- Proceedings of the 1st Workshop on Multilingual Report Generation via Retrieval Augmented Generation (RAG4Reports 2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, CA, USA
- Editors:
- Eugene Yang, Dawn Lawrie, Sean MacAvaney, James Mayfield, Luca Soldaini, Andrew Yates
- Venues:
- RAG4Reports | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 47–56
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.rag4reports-1.6/
- DOI:
- Cite (ACL):
- Sanjay Das, Ran Elgedawy, Ethan Seefried, Ryan A. Burchfield, Gavin Wiggins, Dana Hewit, Sudarshan Srinivasan, Prasanna Balaprakash, Robert M. Patton, Todd Thomas, and Tirthankar Ghosal. 2026. REFSafE: A RAG-Enabled Framework for Predictive Risk Analysis and Automated Safety Report Generation in Mission-Critical Environments. In Proceedings of the 1st Workshop on Multilingual Report Generation via Retrieval Augmented Generation (RAG4Reports 2026), pages 47–56, San Diego, CA, USA. Association for Computational Linguistics.
- Cite (Informal):
- REFSafE: A RAG-Enabled Framework for Predictive Risk Analysis and Automated Safety Report Generation in Mission-Critical Environments (Das et al., RAG4Reports 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.rag4reports-1.6.pdf