SemEval-2025 Task 6: Multinational, Multilingual, Multi-Industry Promise Verification

C h u n g - C h i Chen, Yohei Seki, Hakusen Shu, Anais Lhuissier, Juyeon Kang, Hanwool Lee, Min - Yuh Day, Hiroya Takamura


Abstract
While extensive research exists on misinformation and disinformation, there is limited focus on future-oriented commitments, such as corporate ESG promises, which are often difficult to verify yet significantly impact public trust and market stability. To address this gap, we introduce the task of promise verification, leveraging natural language processing (NLP) techniques to automatically detect ESG commitments, identify supporting evidence, and evaluate the consistency between promises and evidence, while also inferring potential verification time points. This paper presents the dataset used in SemEval-2025 PromiseEval, outlines participant solutions, and discusses key findings. The goal is to enhance transparency in corporate discourse, strengthen investor trust, and support regulators in monitoring the fulfillment of corporate commitments.
Anthology ID:
2025.semeval-1.321
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2461–2471
Language:
URL:
https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.321/
DOI:
Bibkey:
Cite (ACL):
C h u n g - C h i Chen, Yohei Seki, Hakusen Shu, Anais Lhuissier, Juyeon Kang, Hanwool Lee, Min - Yuh Day, and Hiroya Takamura. 2025. SemEval-2025 Task 6: Multinational, Multilingual, Multi-Industry Promise Verification. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 2461–2471, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
SemEval-2025 Task 6: Multinational, Multilingual, Multi-Industry Promise Verification (Chen et al., SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.321.pdf