Findings of the JUST-NLP 2025 Shared Task on Summarization of Indian Court Judgments

Debtanu Datta, Shounak Paul, Kshetrimayum Boynao Singh, Sandeep Kumar, Abhinav Joshi, Shivani Mishra, Sarika Jain, Asif Ekbal, Pawan Goyal, Ashutosh Modi, Saptarshi Ghosh


Abstract
This paper presents an overview of the Shared Task on Summarization of Indian Court Judgments (L-SUMM), hosted by the JUST-NLP 2025 Workshop at IJCNLP-AACL 2025. This task aims to increase research interest in automatic summarization techniques for lengthy and intricate legal documents from the Indian judiciary. It particularly addresses court judgments that contain dense legal reasoning and semantic roles that must be preserved in summaries. As part of this shared task, we introduce the Indian Legal Summarization (L-SUMM) dataset, comprising 1,800 Indian court judgments paired with expert-written abstractive summaries, both in English. Therefore, the task focuses on generating high-quality abstractive summaries of court judgments in English. A total of 9 teams participated in this task, exploring a diverse range of methodologies, including transformer-based models, extractive-abstractive hybrids, graph-based ranking approaches, long-context LLMs, and rhetorical-role-based techniques. This paper describes the task setup, dataset, evaluation framework, and our findings. We report the results and highlight key trends across participant approaches, including the effectiveness of hybrid pipelines and challenges in handling extreme sequence lengths.
Anthology ID:
2025.justnlp-main.2
Volume:
Proceedings of the 1st Workshop on NLP for Empowering Justice (JUST-NLP 2025)
Month:
December
Year:
2025
Address:
Mumbai, India
Editors:
Ashutosh Modi, Saptarshi Ghosh, Asif Ekbal, Pawan Goyal, Sarika Jain, Abhinav Joshi, Shivani Mishra, Debtanu Datta, Shounak Paul, Kshetrimayum Boynao Singh, Sandeep Kumar
Venues:
JUSTNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5–11
Language:
URL:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.justnlp-main.2/
DOI:
Bibkey:
Cite (ACL):
Debtanu Datta, Shounak Paul, Kshetrimayum Boynao Singh, Sandeep Kumar, Abhinav Joshi, Shivani Mishra, Sarika Jain, Asif Ekbal, Pawan Goyal, Ashutosh Modi, and Saptarshi Ghosh. 2025. Findings of the JUST-NLP 2025 Shared Task on Summarization of Indian Court Judgments. In Proceedings of the 1st Workshop on NLP for Empowering Justice (JUST-NLP 2025), pages 5–11, Mumbai, India. Association for Computational Linguistics.
Cite (Informal):
Findings of the JUST-NLP 2025 Shared Task on Summarization of Indian Court Judgments (Datta et al., JUSTNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.justnlp-main.2.pdf