Integrating Expert Labels into LLM-based Emission Goal Detection: Example Selection vs Automatic Prompt Design

Marco Wrzalik, Adrian Ulges, Anne Uersfeld, Florian Faust, Viola Campos


Abstract
We address the detection of emission reduction goals in corporate reports, an important task for monitoring companies’ progress in addressing climate change. Specifically, we focus on the issue of integrating expert feedback in the form of labeled example passages into LLM-based pipelines, and compare the two strategies of (1) a dynamic selection of few-shot examples and (2) the automatic optimization of the prompt by the LLM itself. Our findings on a public dataset of 769 climate-related passages from real-world business reports indicate that automatic prompt optimization is the superior approach, while combining both methods provides only limited benefit. Qualitative results indicate that optimized prompts do indeed capture many intricacies of the targeted emission goal extraction task.
Anthology ID:
2025.climatenlp-1.5
Volume:
Proceedings of the 2nd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2025)
Month:
July
Year:
2025
Address:
Bangkok, Thailand
Editors:
Kalyan Dutia, Peter Henderson, Markus Leippold, Christoper Manning, Gaku Morio, Veruska Muccione, Jingwei Ni, Tobias Schimanski, Dominik Stammbach, Alok Singh, Alba (Ruiran) Su, Saeid A. Vaghefi
Venues:
ClimateNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
68–75
Language:
URL:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.climatenlp-1.5/
DOI:
Bibkey:
Cite (ACL):
Marco Wrzalik, Adrian Ulges, Anne Uersfeld, Florian Faust, and Viola Campos. 2025. Integrating Expert Labels into LLM-based Emission Goal Detection: Example Selection vs Automatic Prompt Design. In Proceedings of the 2nd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2025), pages 68–75, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Integrating Expert Labels into LLM-based Emission Goal Detection: Example Selection vs Automatic Prompt Design (Wrzalik et al., ClimateNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.climatenlp-1.5.pdf