对比了两种耳廓音频匹配方法,发现信号依赖型在高直达声场景下更优且具备抗错鲁棒性。
Performance and Robustness of Signal-Dependent vs. Signal-Independent Binaural Signal Matching with Wearable Microphone Arrays
- 提出基于直达+混响成分的信号依赖型音频匹配方法
- 在声源方向性能显著提升,其他方向几乎无损失
- 方向估计不准时自动退化为稳健的信号无关型表现
空间音频在远程会议、娱乐和虚拟现实中的普及,推动了可穿戴麦克风阵列的耳廓音频重现技术发展。现有方法中,耳廓信号匹配(BSM)适用于小型移动阵列,但其基于扩散声场假设,在高直达声混响比(DRR)场景下表现不佳。本文系统分析了信号依赖型与信号无关型BSM的性能与鲁棒性。研究通过数学建模、仿真和听感测试,验证了两种针对高DRR场景设计的信号依赖型方法:它们结合直达与混响成分声场模型,在声源方向显著提升音质,其余方向性能几乎不变;当声源方向估计错误时,性能退化至与信号无关型相当,展现出良好鲁棒性。
原文摘要 · Abstract (English)
The increasing popularity of spatial audio in applications such as teleconferencing, entertainment, and virtual reality has led to the recent developments of binaural reproduction methods. However, only a few of these methods are well-suited for wearable and mobile arrays, which typically consist of a small number of microphones. One such method is binaural signal matching (BSM), which has been shown to produce high-quality binaural signals for wearable arrays. However, BSM may be suboptimal in cases of high direct-to-reverberant ratio (DRR) as it is based on the diffuse sound field assumption. To overcome this limitation, previous studies incorporated sound-field models other than diffuse. However, performance may be sensitive to signal estimation errors. This paper aims to provide a systematic and comprehensive analysis of signal-dependent vs. signal-independent BSM, so that the benefits and limitations of the methods become clearer. Two signal-dependent BSM-based methods designed for high DRR scenarios that incorporate a sound field model composed of direct and reverberant components are investigated mathematically, using simulations, and finally validated by a listening test, and compared to the signal-independent BSM. The results show that signal-dependent BSM can significantly improve performance, in particular in the direction of the source, while presenting only a negligible degradation in other directions. Furthermore, when source direction estimation is inaccurate, performance of of the signal-dependent BSM degrade to equal that of the signal-independent BSM, presenting a desired robustness quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。