音乐分离模型会扭曲节奏关键特征,仅靠传统指标选模型不够可靠。
Beyond SDR: How Music Source Separation Reshapes Rhythm-Relevant Signal Properties

- 测试四代分离模型对击打时序和动态形态的影响,揭示其系统性偏差
- 攻击波形扭曲程度与主流指标相关性弱,排名甚至反转,说明指标失效
- 输入长度会影响攻击表现,研究中必须报告分离器选择和参数设置
音乐源分离(MSS)正从混音转向量化分析:分离出的鼓轨被用于研究微定时、动态与律动。当前评估几乎全依赖信号-失真比(SDR),但微节奏研究显示,听觉时间位置(p-centre)由起始冲击和包络共同决定,而这是SDR未考虑的属性。本研究基于50首曲目的MUSDB18-HQ数据集,评估了四类代表性分离模型(Spleeter、HT-Demucs、BS-Roformer、SCNetXL)在四个架构世代中的表现。结果表明:(1)起始时序安全,起始检测准确率与SI-SDR相关性为0.62,且不受输入长度影响;(2)瞬态与动态形态严重受损,其失真与SI-SDR相关性极低(|rho| ≤ 0.29),模型排名反转——以高SDR著称的模型攻击波形扭曲是同类能力模型的两倍,而表现最差的模型反而更好保留动态特征;每个模型均引入特定系统性偏倚;(3)固定片段的攻击呈现受输入长度影响(变压器类更明显,配对检验p=0.044),但起始点不变。因此,节奏研究中需明确报告所用分离器及输入条件,仅凭SDR无法替代。
原文摘要 · Abstract (English)
Music source separation (MSS) is increasingly used not to remix music but to measure it: separated drum stems feed studies of microtiming, dynamics, and groove. The field evaluates separators almost exclusively by signal-to-distortion ratio (SDR), yet microrhythm research shows that a sound's perceived temporal location (its p-centre) is co-determined by its attack and envelope, precisely the properties SDR was not designed to protect. We quantify what four open separators spanning four architecture generations (Spleeter, HT-Demucs, BS-Roformer, SCNetXL) do to rhythm-critical signal properties, using the 50-track MUSDB18-HQ test set, where true stems make every claim falsifiable. Three findings emerge. (1) Onset timing is safe: onset F-measure tracks SI-SDR (Spearman rho = 0.62) and is invariant to input length. (2) Transient and dynamic shape are not: their distortion correlates only weakly with SI-SDR (|rho| <= 0.29), and the model ranking inverts - the SDR leader distorts drum attacks twice as much as its capability-matched CNN counterpart, while the SDR-worst model preserves dynamics better than a mid-pack one. Each model imposes a systematic, model-specific bias on the dynamic profile. (3) Input length reshapes the rendered attack of a fixed passage (marginally more for the transformer; paired p = 0.044) while leaving onset locations untouched. For rhythmic studies, separator choice and input conditions are methodological variables to be reported, and SDR alone cannot stand in for them.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。