Anchored Cyclic Generation: A Novel Paradigm for Long-Sequence Symbolic Music Generation

Boyu Cao, Lekai Qian, Dehan Li, Haoyu Gu, Mingda Xu, Qi Liu


Abstract
Generating long sequences with structural coherence remains a fundamental challenge for autoregressive models across sequential generation tasks. In symbolic music generation, this challenge is particularly pronounced, as existing methods are constrained by the severe error accumulation inherent in autoregressive models, leading to poor performance in music quality and structural integrity. In this paper, we propose the Anchored Cyclic Generation (ACG) paradigm, which relies on anchor features from previously generated musical content to guide subsequent generation during the autoregressive process, effectively mitigating error accumulation in autoregressive methods. Based on the ACG paradigm, we further propose the Hierarchical Anchored Cyclic Generation (Hi-ACG) framework, which employs a systematic global-to-local generation strategy and is highly compatible with our specifically designed piano token, an efficient musical representation. The experimental results demonstrate that compared to traditional autoregressive models, the ACG paradigm reduces cosine distance by an average of 34.7% between predicted feature vectors and ground-truth semantic vectors. In long-sequence symbolic music generation tasks, the Hi-ACG framework significantly outperforms existing mainstream methods in both subjective and objective evaluations. Furthermore, the framework exhibits excellent task generalization capabilities, achieving superior performance in related tasks such as music completion.
Anthology ID:
2026.findings-acl.1574
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
31463–31476
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1574/
DOI:
Bibkey:
Cite (ACL):
Boyu Cao, Lekai Qian, Dehan Li, Haoyu Gu, Mingda Xu, and Qi Liu. 2026. Anchored Cyclic Generation: A Novel Paradigm for Long-Sequence Symbolic Music Generation. In Findings of the Association for Computational Linguistics: ACL 2026, pages 31463–31476, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Anchored Cyclic Generation: A Novel Paradigm for Long-Sequence Symbolic Music Generation (Cao et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1574.pdf
Checklist:
 2026.findings-acl.1574.checklist.pdf