利用空间先验信息提升混音中声源分离效果
On Ambisonic Source Separation with Spatially Informed Non-negative Tensor Factorization
- 基于非负张量分解,融合方向到达先验约束
- 在不同声源数和混响条件下均优于传统方法
- 适合需要精准空间定位的音频处理场景
本文提出一种基于非负张量分解的声源分离方法,用于处理全向麦克风信号。该方法在最大后验概率框架下,通过空间协方差矩阵(SCM)的约束引入声源到达方向(DOA)先验知识。文中详细推导了四种算法,结合两种代价函数(欧氏距离与Itakura-Saito散度)和两种先验分布(Wishart与逆Wishart)。实验基于一阶全向录音,使用四组数据集(三组音乐、一组语音),分别在两、四、六个声源的欠定、确定及超定情形下评估。同时测试不同球谐阶数、混响时间及先验方向受损情况下的性能。结果表明,相比波束成形、现有先进方法及基线最大似然法,所提MAP方法在标准客观指标(SDR、ISR、SIR、SAR)上表现更优。
原文摘要 · Abstract (English)
This article presents a Non-negative Tensor Factorization based method for sound source separation from Ambisonic microphone signals. The proposed method enables the use of prior knowledge about the Directions-of-Arrival (DOAs) of the sources, incorporated through a constraint on the Spatial Covariance Matrix (SCM) within a Maximum a Posteriori (MAP) framework. Specifically, this article presents a detailed derivation of four algorithms that are based on two types of cost functions, namely the squared Euclidean distance and the Itakura-Saito divergence, which are then combined with two prior probability distributions on the SCM, that is the Wishart and the Inverse Wishart. The experimental evaluation of the baseline Maximum Likelihood (ML) and the proposed MAP methods is primarily based on first-order Ambisonic recordings, using four different source signal datasets, three with musical pieces and one containing speech utterances. We consider under-determined, determined, as well as over-determined scenarios by separating two, four and six sound sources, respectively. Furthermore, we evaluate the proposed algorithms for different spherical harmonic orders and at different reverberation time levels, as well as in non-ideal prior knowledge conditions, for increasingly more corrupted DOAs. Overall, in comparison with beamforming and a state-of-the-art separation technique, as well as the baseline ML methods, the proposed MAP approach offers superior separation performance in a variety of scenarios, as shown by the analysis of the experimental evaluation results, in terms of the standard objective separation measures, such as the SDR, ISR, SIR and SAR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。