Fathima Firose A
2025
Hierarchical Long-Document Summarization using LED for Legal Judgments
Reshma Sheik
|
Noah John Puthayathu
|
Fathima Firose A
|
Jonathan Paul
Proceedings of the 1st Workshop on NLP for Empowering Justice (JUST-NLP 2025)
This paper describes our system for the L-SUMM shared task on legal document summarization. Our approach is built on the Longformer Encoder-Decoder (LED) model, which we augment with a multi-level summarization strategy tailored for legal documents that are substantially longer than typical transformer input limits. The system achieved competitive performance on the legal judgment summarization task through optimized training strategies, including gradient accumulation, Adafactor optimization, and hyperparameter tuning. Our findings indicate that combining hierarchical processing with strategically assigned global attention enables more reliable summarization of lengthy legal texts.