Abstract
In this paper, we describe our approach to the ML-ESG-2 shared task, co-located with the FinNLP workshop at IJCNLP-AACL-2023. The task aims at classifying news articles into categories reflecting either “Opportunity” or “Risk” from an ESG standpoint for companies. Our innovative methodology leverages two distinct systems for optimal text classification. In the initial phase, we engage in prompt engineering, working in conjunction with semantic similarity and using the Claude 2 LLM. Subsequently, we apply fine-tuning techniques to the Llama 2 and Dolly LLMs to enhance their performance. We report the results of five different approaches in this paper, with our top models ranking first in the French category and sixth in the English category.- Anthology ID:
- 2023.finnlp-2.11
- Volume:
- Proceedings of the Sixth Workshop on Financial Technology and Natural Language Processing
- Month:
- November
- Year:
- 2023
- Address:
- Bali, Indonesia
- Editors:
- Chung-Chi Chen, Hen-Hsen Huang, Hiroya Takamura, Hsin-Hsi Chen, Hiroki Sakaji, Kiyoshi Izumi
- Venues:
- FinNLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 72–78
- Language:
- URL:
- https://aclanthology.org/2023.finnlp-2.11
- DOI:
- 10.18653/v1/2023.finnlp-2.11
- Cite (ACL):
- Soumya Mishra. 2023. ESG Impact Type Classification: Leveraging Strategic Prompt Engineering and LLM Fine-Tuning. In Proceedings of the Sixth Workshop on Financial Technology and Natural Language Processing, pages 72–78, Bali, Indonesia. Association for Computational Linguistics.
- Cite (Informal):
- ESG Impact Type Classification: Leveraging Strategic Prompt Engineering and LLM Fine-Tuning (Mishra, FinNLP-WS 2023)
- PDF:
- https://preview.aclanthology.org/naacl-24-ws-corrections/2023.finnlp-2.11.pdf