用高阶轨迹积分实现零样本音乐编辑,保持原曲结构同时精准改风格音色。
FlowSonic: Stable Zero-Shot Music Editing via High-Order Trajectory Integration

- 通过确定性逆映射将录音转至隐空间,复用注意力特征保结构。
- 采用高阶常微分方程求解器,显著提升编辑过程数值稳定性。
- 适合需要高保真、可控音乐修改的创作与研究者使用。
零样本文本引导的现实音乐录音编辑需在语义修改与原音乐结构忠实保留间取得平衡。尽管基于修正流训练的扩散变换器在文本到音乐生成中表现卓越,将其扩展至现有录音编辑仍具挑战性,因编辑需精确的确定性反演、可靠的结构保留及反演与生成过程中的数值稳定性。本文提出FlowSonic,一个基于预训练修正流扩散变换器的零样本音乐编辑框架。FlowSonic首先将真实录音确定性地反演至隐空间,并通过重用反演期间提取的交叉注意力表示来保持其音乐结构。为提升基于反演编辑的数值可靠性,我们引入高阶常微分方程求解器,并系统研究不同数值积分方案对轨迹稳定性、结构保留与语义可控性的影响。在音色迁移与流派修改任务上的全面实验表明,FlowSonic在语义对齐、和声保留、结构一致性及听觉质量方面持续优于现有方法。我们进一步通过几何与实证分析表明,所提数值积分策略提升了隐空间轨迹稳定性,带来更可靠的音乐编辑效果。
原文摘要 · Abstract (English)
Zero-shot text-guided editing of real-world music recordings requires balancing semantic modification with faithful preservation of the original musical structure. Although recent diffusion transformers trained with rectified flow have achieved remarkable success in text-to-music generation, extending them to edit existing recordings remains challenging because editing requires accurate deterministic inversion, reliable structural preservation, and numerically stable integration throughout the inversion and generation processes. We present FlowSonic, a zero-shot music editing framework built upon a pretrained diffusion transformer trained with rectified flow. FlowSonic first deterministically inverts a real-world recording into the latent space and preserves its musical structure during editing by reusing cross-attention representations extracted during inversion. To improve the numerical reliability of inversion-based editing, we introduce a high-order ODE solver and systematically investigate how different numerical integration schemes influence trajectory stability, structural preservation, and semantic controllability. Comprehensive experiments on timbre-transfer and genre-modification tasks demonstrate that FlowSonic consistently outperforms existing music editing methods across semantic alignment, harmonic preservation, structural consistency, and perceptual audio quality. We further provide geometric and empirical analyses showing how the proposed numerical integration strategy improves latent trajectory stability and leads to more reliable music editing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。