arXiv:2506.16889cs.SDeess.AS2025-06被引 5

让音乐母带处理可实时微调,用户能精准控制音色风格。

ITO-Master: Inference-Time Optimization for Audio Effects Modeling of Music Mastering Processors

  • 推理时优化参考音色嵌入,实现动态调整
  • 提升不同风格下母带处理效果,增强风格相似度
  • 支持文本条件控制,适合音乐人精细调音

音乐母带风格迁移旨在建模并应用参考曲目的母带特征到目标曲目,模拟专业母带处理流程。然而,现有方法基于参考曲目固定处理,限制了用户根据艺术意图进行微调的能力。本文提出ITO-Master框架,一种基于参考的母带风格迁移系统,集成推理时优化(ITO),实现对母带过程的更精细用户控制。通过在推理阶段优化参考嵌入,该方法允许用户动态调整输出,实现微调级的精确母带效果。我们探索了黑盒与白盒两种母带处理器建模方法,并证明ITO在不同风格下均提升了母带性能。通过客观评估、主观听感测试及基于CLAP嵌入的文本条件分析,验证了ITO在增强母带风格相似性的同时提升了适应性。本框架为母带风格迁移提供了高效且可控的解决方案,使用户可超越初始迁移结果进一步优化。

原文摘要 · Abstract (English)

Music mastering style transfer aims to model and apply the mastering characteristics of a reference track to a target track, simulating the professional mastering process. However, existing methods apply fixed processing based on a reference track, limiting users' ability to fine-tune the results to match their artistic intent. In this paper, we introduce the ITO-Master framework, a reference-based mastering style transfer system that integrates Inference-Time Optimization (ITO) to enable finer user control over the mastering process. By optimizing the reference embedding during inference, our approach allows users to refine the output dynamically, making micro-level adjustments to achieve more precise mastering results. We explore both black-box and white-box methods for modeling mastering processors and demonstrate that ITO improves mastering performance across different styles. Through objective evaluation, subjective listening tests, and qualitative analysis using text-based conditioning with CLAP embeddings, we validate that ITO enhances mastering style similarity while offering increased adaptability. Our framework provides an effective and user-controllable solution for mastering style transfer, allowing users to refine their results beyond the initial style transfer.

音乐生成风格迁移推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。