用锚点循环生成法解决长序列音乐生成的误差累积问题
Anchored Cyclic Generation: A Novel Paradigm for Long-Sequence Symbolic Music Generation

- 引入锚点特征引导生成,缓解自回归模型误差积累
- 长序列音乐生成中语义向量相似度提升34.7%(余弦距离下降)
- 适合需要结构完整性的长音乐生成与补全任务
长序列生成中的结构一致性仍是自回归模型面临的根本挑战。在符号化音乐生成中,这一问题尤为突出,因现有方法受限于自回归模型固有的严重误差累积,导致音乐质量与结构完整性较差。本文提出锚点循环生成(ACG)范式,利用已识别音乐中的锚点特征,在自回归过程中引导后续生成,有效缓解误差累积。基于此范式,我们进一步提出分层锚点循环生成(Hi-ACG)框架,采用系统化的全局到局部生成策略,并兼容专为钢琴设计的高效音乐标记表示。实验表明,相比传统自回归模型,ACG范式使预测特征向量与真实语义向量间的余弦距离平均降低34.7%。在长序列符号化音乐生成任务中,Hi-ACG框架在主观与客观评估上均显著优于主流方法。此外,该框架具备优异的任务泛化能力,在音乐补全等关联任务中也表现卓越。
原文摘要 · Abstract (English)
Generating long sequences with structural coherence remains a fundamental challenge for autoregressive models across sequential generation tasks. In symbolic music generation, this challenge is particularly pronounced, as existing methods are constrained by the inherent severe error accumulation problem of autoregressive models, leading to poor performance in music quality and structural integrity. In this paper, we propose the Anchored Cyclic Generation (ACG) paradigm, which relies on anchor features from already identified music to guide subsequent generation during the autoregressive process, effectively mitigating error accumulation in autoregressive methods. Based on the ACG paradigm, we further propose the Hierarchical Anchored Cyclic Generation (Hi-ACG) framework, which employs a systematic global-to-local generation strategy and is highly compatible with our specifically designed piano token, an efficient musical representation. The experimental results demonstrate that compared to traditional autoregressive models, the ACG paradigm achieves reduces cosine distance by an average of 34.7% between predicted feature vectors and ground-truth semantic vectors. In long-sequence symbolic music generation tasks, the Hi-ACG framework significantly outperforms existing mainstream methods in both subjective and objective evaluations. Furthermore, the framework exhibits excellent task generalization capabilities, achieving superior performance in related tasks such as music completion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。