Aligning Unstructured Paris Agreement Climate Plans with Sustainable Development Goals
Daniel Spokoyny, Janelle Cai, Tom Corringham, Taylor Berg-Kirkpatrick
Abstract
Aligning unstructured climate policy documents according to a particular classification taxonomy with little to no labeled examples is challenging and requires manual effort of climate policy researchers. In this work we examine whether large language models (LLMs) can act as an effective substitute or assist in the annotation process. Utilizing a large set of text spans from Paris Agreement Nationally Determined Contributions (NDCs) linked to United Nations Sustainable Development Goals (SDGs) and targets contained in the Climate Watch dataset from the World Resources Institute in combination with our own annotated data, we validate our approaches and establish a benchmark for model performance evaluation on this task. With our evaluation benchmarking we quantify the effectiveness of using zero-shot or few-shot prompted LLMs to align these documents.- Anthology ID:
- 2024.climatenlp-1.17
- Volume:
- Proceedings of the 1st Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2024)
- Month:
- August
- Year:
- 2024
- Address:
- Bangkok, Thailand
- Editors:
- Dominik Stammbach, Jingwei Ni, Tobias Schimanski, Kalyan Dutia, Alok Singh, Julia Bingler, Christophe Christiaen, Neetu Kushwaha, Veruska Muccione, Saeid A. Vaghefi, Markus Leippold
- Venues:
- ClimateNLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 223–232
- Language:
- URL:
- https://aclanthology.org/2024.climatenlp-1.17
- DOI:
- 10.18653/v1/2024.climatenlp-1.17
- Cite (ACL):
- Daniel Spokoyny, Janelle Cai, Tom Corringham, and Taylor Berg-Kirkpatrick. 2024. Aligning Unstructured Paris Agreement Climate Plans with Sustainable Development Goals. In Proceedings of the 1st Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2024), pages 223–232, Bangkok, Thailand. Association for Computational Linguistics.
- Cite (Informal):
- Aligning Unstructured Paris Agreement Climate Plans with Sustainable Development Goals (Spokoyny et al., ClimateNLP-WS 2024)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-5/2024.climatenlp-1.17.pdf