改进耳机声重现效果，让可穿戴麦克风阵列的全景音更逼真。
Ambisonics Encoder for Wearable Array with Improved Binaural Reproduction
- 在损失函数中加入双耳信号匹配项，统一优化全景音与双耳听感。
- 仿真测试显示双耳还原精度显著提升，适合虚拟现实应用。
- 特别适合追求高保真耳机听觉体验的研究者和开发者。
Ambisonics Signal Matching (ASM) 是一种最近提出的、与信号无关的编码方法，可将可穿戴麦克风阵列采集的全景声音信号进行编码，实现高效且标准化的空间声音重放。然而，由于麦克风布局不理想，当前的还原精度受限。本文提出一种增强型 ASM 编码器，通过在优化框架中引入双耳信号匹配（Binaural Signal Matching, BSM）项，重构损失函数。该设计旨在提升将全景音信号与头相关传输函数（HRTFs）结合后的双耳还原准确性，使编码后的全景音更适合双耳播放。论文首先推导出同时对齐 ASM 与 BSM 目标的一致损失函数，并基于安装在刚性球体上的模拟麦克风阵列开展仿真研究。结果表明，采用联合的 ASM-BSM 优化策略，可显著改善双耳还原效果，从而为基于全景音的虚拟现实与增强现实应用提供更高品质的双耳播放体验。
原文摘要 · Abstract (English)
Ambisonics Signal Matching (ASM) is a recently proposed signal-independent approach to encoding Ambisonic signal from wearable microphone arrays, enabling efficient and standardized spatial sound reproduction. However, reproduction accuracy is currently limited due to the non-ideal layout of the microphones. This research introduces an enhanced ASM encoder that reformulates the loss function by integrating a Binaural Signal Matching (BSM) term into the optimization framework. The aim of this reformulation is to improve the accuracy of binaural reproduction when integrating the Ambisonic signal with Head-Related Transfer Functions (HRTFs), making the encoded Ambisonic signal better suited for binaural reproduction. This paper first presents the mathematical formulation developed to align the ASM and BSM objectives in a single loss function, followed by a simulation study with a simulated microphone array mounted on a rigid sphere representing a head-mounted wearable array. The analysis shows that improved binaural reproduction with the encoded Ambisonic signal can be achieved using this joint ASM-BSM optimization, thereby enabling higher-quality binaural playback for virtual and augmented reality applications based on Ambisonics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。