Enhancing Legal Violation Identification with LLMs and Deep Learning Techniques: Achievements in the LegalLens 2024 Competition
Nguyen Tan Minh, Duy Ngoc Mai, Le Xuan Bach, Nguyen Huu Dung, Pham Cong Minh, Ha Thanh Nguyen, Thi Hai Yen Vuong
Abstract
LegalLens is a competition organized to encourage advancements in automatically detecting legal violations. This paper presents our solutions for two tasks Legal Named Entity Recognition (L-NER) and Legal Natural Language Inference (L-NLI). Our approach involves fine-tuning BERT-based models, designing methods based on data characteristics, and a novel prompting template for data augmentation using LLMs. As a result, we secured first place in L-NER and third place in L-NLI among thirty-six participants. We also perform error analysis to provide valuable insights and pave the way for future enhancements in legal NLP. Our implementation is available at https://github.com/lxbach10012004/legal-lens/tree/main- Anthology ID:
- 2024.nllp-1.28
- Volume:
- Proceedings of the Natural Legal Language Processing Workshop 2024
- Month:
- November
- Year:
- 2024
- Address:
- Miami, FL, USA
- Editors:
- Nikolaos Aletras, Ilias Chalkidis, Leslie Barrett, Cătălina Goanță, Daniel Preoțiuc-Pietro, Gerasimos Spanakis
- Venues:
- NLLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 336–345
- Language:
- URL:
- https://preview.aclanthology.org/jlcl-multiple-ingestion/2024.nllp-1.28/
- DOI:
- 10.18653/v1/2024.nllp-1.28
- Cite (ACL):
- Nguyen Tan Minh, Duy Ngoc Mai, Le Xuan Bach, Nguyen Huu Dung, Pham Cong Minh, Ha Thanh Nguyen, and Thi Hai Yen Vuong. 2024. Enhancing Legal Violation Identification with LLMs and Deep Learning Techniques: Achievements in the LegalLens 2024 Competition. In Proceedings of the Natural Legal Language Processing Workshop 2024, pages 336–345, Miami, FL, USA. Association for Computational Linguistics.
- Cite (Informal):
- Enhancing Legal Violation Identification with LLMs and Deep Learning Techniques: Achievements in the LegalLens 2024 Competition (Tan Minh et al., NLLP 2024)
- PDF:
- https://preview.aclanthology.org/jlcl-multiple-ingestion/2024.nllp-1.28.pdf