Abstract
In the evolving landscape of Environmental, Social, and Corporate Governance (ESG) impact assessment, the ML-ESG-2 shared task proposes identifying ESG impact types. To address this challenge, we present a comprehensive system leveraging ensemble learning techniques, capitalizing on early and late fusion approaches. Our approach employs four distinct models: mBERT, FlauBERT-base, ALBERT-base-v2, and a Multi-Layer Perceptron (MLP) incorporating Latent Semantic Analysis (LSA) and Term Frequency-Inverse Document Frequency (TF-IDF) features. Through extensive experimentation, we find that our early fusion ensemble approach, featuring the integration of LSA, TF-IDF, mBERT, FlauBERT-base, and ALBERT-base-v2, delivers the best performance. Our system offers a comprehensive ESG impact type identification solution, contributing to the responsible and sustainable decision-making processes vital in today’s financial and corporate governance landscape.- Anthology ID:
- 2023.finnlp-2.13
- Volume:
- Proceedings of the Sixth Workshop on Financial Technology and Natural Language Processing
- Month:
- November
- Year:
- 2023
- Address:
- Bali, Indonesia
- Editors:
- Chung-Chi Chen, Hen-Hsen Huang, Hiroya Takamura, Hsin-Hsi Chen, Hiroki Sakaji, Kiyoshi Izumi
- Venues:
- FinNLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 84–90
- Language:
- URL:
- https://aclanthology.org/2023.finnlp-2.13
- DOI:
- 10.18653/v1/2023.finnlp-2.13
- Cite (ACL):
- Hariram Veeramani, Surendrabikram Thapa, and Usman Naseem. 2023. Enhancing ESG Impact Type Identification through Early Fusion and Multilingual Models. In Proceedings of the Sixth Workshop on Financial Technology and Natural Language Processing, pages 84–90, Bali, Indonesia. Association for Computational Linguistics.
- Cite (Informal):
- Enhancing ESG Impact Type Identification through Early Fusion and Multilingual Models (Veeramani et al., FinNLP-WS 2023)
- PDF:
- https://preview.aclanthology.org/improve-issue-templates/2023.finnlp-2.13.pdf