ESG-KG: A Multi-modal Knowledge Graph System for Automated Compliance Assessment

Li-Yang Chang, Chih-Ming Chen, Hen-Hsen Huang, Ming-Feng Tsai, An-Zi Yen, Chuan-Ju Wang


Abstract
Our system is built upon a multi-modal information extraction pipeline designed to process and interpret corporate sustainability reports. This integrated framework systematically handles diverse data formats—including text, tables, figures, and infographics—to extract, structure, and evaluate ESG-related content. The extracted multi-modal data is subsequently formalized into a structured knowledge graph (KG), which serves as both a semantic framework for representing entities, relationships, and metrics relevant to ESG domains, and as the foundational infrastructure for the automated compliance system. This KG enables high-precision retrieval of information across multiple source formats and reporting modalities. The trustworthy, context-rich representations provided by the knowledge graph establish a verifiable evidence base, creating a critical foundation for reliable retrieval-augmented generation (RAG) and subsequent LLM-based scoring and analysis of automatic ESG compliance system.
Anthology ID:
2026.eacl-demo.43
Volume:
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations)
Month:
March
Year:
2026
Address:
Rabat, Marocco
Editors:
Danilo Croce, Jochen Leidner, Nafise Sadat Moosavi
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
602–608
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-demo.43/
DOI:
Bibkey:
Cite (ACL):
Li-Yang Chang, Chih-Ming Chen, Hen-Hsen Huang, Ming-Feng Tsai, An-Zi Yen, and Chuan-Ju Wang. 2026. ESG-KG: A Multi-modal Knowledge Graph System for Automated Compliance Assessment. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations), pages 602–608, Rabat, Marocco. Association for Computational Linguistics.
Cite (Informal):
ESG-KG: A Multi-modal Knowledge Graph System for Automated Compliance Assessment (Chang et al., EACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-demo.43.pdf