现有空间音效评估指标不可靠，尤其对低频乐器分离效果判断不准。
Spacing Out: On the Reliability of Binaural Music Source Separation Metrics
- 提出用听觉实验验证空间度量与人感知的一致性
- 发现时差估计对噪声和分离伪影极敏感
- 适合做沉浸式音乐分离的模型评估研究者
尽管沉浸式音频日益流行，但双耳音乐在音乐信息检索（MIR）中仍鲜有研究，尤其是在音乐源分离（MSS）任务方面。现有立体声MSS模型虽可处理双耳音频，但常破坏分离音轨的空间质量，削弱听觉沉浸感。通过对比双耳与立体声MSS输出的感知实验，我们评估客观空间失真度量与人类感知的相关性。结果表明，这些度量与人类判断一致性参差不齐，用于评估双耳音乐任务时可靠性不足。具体而言，双耳时间差（ITD）估计对噪声和分离伪影高度敏感。在比较两种替代的ITD估计方法时，发现鲁棒性与准确性之间存在关键权衡，尤其在窄带乐器如贝斯上表现明显。这凸显了需开发针对双耳音乐设计的精确、可解释的空间度量，以支持保留源定位与听觉沉浸感的模型发展。
原文摘要 · Abstract (English)
Despite the rising popularity of immersive audio, binaural music remains underexplored in music information retrieval (MIR), particularly regarding the task of music source separation (MSS). While existing stereo MSS models can process binaural audio, they often degrade the spatial quality of the separated stems and undermine listener immersion. Through a perceptual study comparing binaural and stereo MSS outputs, we evaluate how well objective spatial distortion metrics correlate with human perception. Our findings reveal varied agreement between these metrics and human judgment, highlighting a lack of reliability when used to evaluate binaural music tasks. Specifically, we find that Interaural Time Difference (ITD) estimation is highly sensitive to noise and separation artifacts. In evaluating two alternative ITD estimation methods, we uncover a critical trade-off between robustness and accuracy, particularly for narrow-band instruments like bass. These results underscore the need for accurate, interpretable spatial metrics designed for binaural music to develop models that preserve source localization and listener immersion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。