RegTrack: A Fine-Grained Benchmark for Multi-Class Legal Change Detection

Joe Yu, Kevin Chenhao Li, Julian Ostarek


Abstract
Organizations must continuously monitor evolving regulations to maintain compliance. While current tools are limited to surface-level text comparison, existing models lack the finegrained classification schemes to determine whether small changes impact legal obligations or merely update formatting. To address this gap, we introduce a novel benchmark for change detection in EU regulations. It comprises 4,772 manually annotated pairs of structurally distinct provisions, defined as Atomic Legal Units (ALUs), mapped to a six-class taxonomy of legal change types. We formalize three core tasks: structural alignment, change classification, and a combined task requiring simultaneous alignment and classification. Evaluating lexical algorithms, dense encoders, and Large Language Models (LLMs) as baselines, we find LLMs excel at isolated change classification, whereas domain-specific dense encoders offer the most robust combined performance. By providing fine-grained labeled data, this benchmark enables the development of AI systems that can help organizations analyze regulatory shifts and support version-aware retrieval in the legal domain.
Anthology ID:
2026.acl-srw.68
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Santosh T.Y.S.S., Juan Diego Rodriguez, Ona de Gibert
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
764–778
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-srw.68/
DOI:
Bibkey:
Cite (ACL):
Joe Yu, Kevin Chenhao Li, and Julian Ostarek. 2026. RegTrack: A Fine-Grained Benchmark for Multi-Class Legal Change Detection. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026), pages 764–778, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
RegTrack: A Fine-Grained Benchmark for Multi-Class Legal Change Detection (Yu et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-srw.68.pdf