Sarang at FinCausal 2025: Contextual QA for Financial Causality Detection Combining Extractive and Generative Models
Avinash Trivedi, Gauri Toshniwal, Sangeetha S, S R. Balasundaram
Abstract
This paper describes our approach for the FinCausal 2025 English Shared Task, aimed at detecting and extracting causal relationships from the financial text. The task involved answering context-driven questions to identify causes or effects within specified text segments. Our method utilized a consciousAI RoBERTa-base encoder model, fine-tuned on the SQuADx dataset. We further fine-tuned it using the FinCausal 2025 development set. To enhance the quality and contextual relevance of the answers, we passed outputs from the extractive model through Gemma2-9B, a generative large language model, for answer refinement. This hybrid approach effectively addressed the task’s requirements, showcasing the strength of combining extractive and generative models. We (Team name: Sarang) achieved outstanding results, securing 3rd rank with a Semantic Answer Similarity (SAS) score of 96.74% and an Exact Match (EM) score of 70.14%.- Anthology ID:
- 2025.finnlp-1.25
- Volume:
- Proceedings of the Joint Workshop of the 9th Financial Technology and Natural Language Processing (FinNLP), the 6th Financial Narrative Processing (FNP), and the 1st Workshop on Large Language Models for Finance and Legal (LLMFinLegal)
- Month:
- January
- Year:
- 2025
- Address:
- Abu Dhabi, UAE
- Editors:
- Chung-Chi Chen, Antonio Moreno-Sandoval, Jimin Huang, Qianqian Xie, Sophia Ananiadou, Hsin-Hsi Chen
- Venues:
- FinNLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 242–247
- Language:
- URL:
- https://preview.aclanthology.org/fix-sig-urls/2025.finnlp-1.25/
- DOI:
- Cite (ACL):
- Avinash Trivedi, Gauri Toshniwal, Sangeetha S, and S R. Balasundaram. 2025. Sarang at FinCausal 2025: Contextual QA for Financial Causality Detection Combining Extractive and Generative Models. In Proceedings of the Joint Workshop of the 9th Financial Technology and Natural Language Processing (FinNLP), the 6th Financial Narrative Processing (FNP), and the 1st Workshop on Large Language Models for Finance and Legal (LLMFinLegal), pages 242–247, Abu Dhabi, UAE. Association for Computational Linguistics.
- Cite (Informal):
- Sarang at FinCausal 2025: Contextual QA for Financial Causality Detection Combining Extractive and Generative Models (Trivedi et al., FinNLP 2025)
- PDF:
- https://preview.aclanthology.org/fix-sig-urls/2025.finnlp-1.25.pdf