arXiv:2603.21282cs.LGcs.AI2026-03被引 1

混合模型结合LSTM与Transformer优势,提升音乐生成的局部连贯与全局结构。

Fusing Memory and Attention: A study on LSTM, Transformer and Hybrid Architectures for Symbolic Music Generation

  • 用Transformer编码器+LSTM解码器构建混合架构,融合两者优势。
  • 在Deutschl数据集上生成1000首曲子,混合模型在17项指标中表现更优。
  • 实验含消融分析与人类听觉评估,结果可信且具实际应用价值。

机器学习技术如Transformer和长短期记忆网络(LSTM)在符号化音乐生成(SMG)中扮演关键角色。现有研究指出LSTM擅长建模局部旋律连续性,而Transformer更擅长保持全局结构一致性,但二者在SMG中的具体特性尚未系统研究。本文通过细粒度对比分析LSTM与Transformer在SMG中的表现,使用17项音乐质量指标对Deutschl数据集进行评估。结果表明,LSTM能有效捕捉局部模式,但难以维持长距离依赖;而Transformer虽能建模全局结构,却易产生不规则乐句。基于此,我们提出一种混合架构:使用Transformer编码器与LSTM解码器相结合,并在三种模型各生成1000首旋律的基础上进行评估。结果显示,该混合方法在局部与全局连贯性及一致性方面均优于基线模型。研究还通过消融实验和人类感知评估验证结论,提供有力支持。

原文摘要 · Abstract (English)

Machine learning techniques, such as Transformers and Long Short-Term Memory (LSTM) networks, play a crucial role in Symbolic Music Generation (SMG). Existing literature indicates a difference between LSTMs and Transformers regarding their ability to model local melodic continuity versus maintaining global structural coherence. However, their specific properties within the context of SMG have not been systematically studied. This paper addresses this gap by providing a fine-grained comparative analysis of LSTMs versus Transformers for SMG, examining local and global properties in detail using 17 musical quality metrics on the Deutschl dataset. We find that LSTM networks excel at capturing local patterns but fail to preserve long-range dependencies, while Transformers model global structure effectively but tend to produce irregular phrasing. Based on this analysis and leveraging their respective strengths, we propose a Hybrid architecture combining a Transformer Encoder with an LSTM Decoder and evaluate it against both baselines. We evaluated 1,000 generated melodies from each of the three architectures on the Deutschl dataset. The results show that the hybrid method achieves better local and global continuity and coherence compared to the baselines. Our work highlights the key characteristics of these models and demonstrates how their properties can be leveraged to design superior models. We also supported the experiments with ablation studies and human perceptual evaluations, which statistically support the findings and provide robust validation for this work.

音乐生成混合模型LSTMTransformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。