arXiv:2501.18227eess.AScs.SD2025-01中稿 · IEEE TASLP被引 2

提升头戴麦克风阵列的立体声还原效果,让耳机听感更真实。

BSM-iMagLS: ILD Informed Binaural Signal Matching for Reproduction with Head-Mounted Microphone Arrays

  • 融合双耳强度差优化,改进原有信号匹配方法。
  • 在多种头型数据和阵列布局下,双耳强度误差显著降低。
  • 适合便携式设备如VR/AR头显的高质量空间音频还原。

虚拟现实与增强现实中的耳机听觉体验依赖高质量的空间音频以保证沉浸感,而佩戴式麦克风阵列通常仅有少量不规则分布的麦克风,难以达到多麦克风阵列的还原水平。近期提出的双耳信号匹配(BSM)方法可在仅用少量麦克风的情况下生成高质量的双耳信号,其在高频段通过幅度最小二乘(MagLS)优化进一步提升性能。本文提出BSM-iMagLS,将双耳强度差(ILD)引入MagLS,并整合进BSM框架中。采用基于深度神经网络(DNN)的求解器,实现幅度、双耳强度差及幅度导数的联合优化,显著提升空间保真度。通过理论分析、多种头-耳传输函数(HRTFs)与头戴阵列几何结构的数值仿真,以及听觉实验验证,结果表明该方法在保持与现有先进方案相当的幅度精度的同时,大幅降低双耳强度差误差,展现出在可穿戴与便携设备上提升双耳还原效果的巨大潜力。

原文摘要 · Abstract (English)

Headphone listening in applications such as augmented and virtual reality (AR and VR) relies on high-quality spatial audio to ensure immersion, making accurate binaural reproduction a critical component. As capture devices, wearable arrays with only a few microphones with irregular arrangement face challenges in achieving a reproduction quality comparable to that of arrays with a large number of microphones. Binaural signal matching (BSM) has recently been presented as a signal-independent approach for generating high-quality binaural signal using only a few microphones, which is further improved using magnitude-least squares (MagLS) optimization at high frequencies. This paper extends BSM with MagLS by introducing interaural level difference (ILD) into the MagLS, integrated into BSM (BSM-iMagLS). Using a deep neural network (DNN)-based solver, BSM-iMagLS achieves joint optimization of magnitude, ILD, and magnitude derivatives, improving spatial fidelity. Performance is validated through theoretical analysis, numerical simulations with diverse HRTFs and head-mounted array geometries, and listening experiments, demonstrating a substantial reduction in ILD errors while maintaining comparable magnitude accuracy to state-of-the-art solutions. The results highlight the potential of BSM-iMagLS to enhance binaural reproduction for wearable and portable devices.

空间音频双耳还原麦克风阵列虚拟现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。