用四只手机麦克风实现四阶空间音频编码与扩展。
SHB-AE: Spherical harmonic beamforming based Ambisonics encoding and upscaling method for smartphone microphone array
- 基于球谐波波束成形设计各阶波束成形器，适配不规则手机麦克阵列。
- 在混响和噪声环境下成功实现四阶音场编码与上采样。
- 适合移动设备空间音频采集，突破传统麦克风阵列体积限制。
随着虚拟现实（VR）和增强现实（AR）的快速发展，空间音频录制与回放受到越来越多关注。高阶全向声学（HOA）因其对多种播放设备的适应性及与头部方向融合的能力而脱颖而出。然而，现有HOA录音通常依赖于大型球形麦克风阵列（SMA），而智能手机等便携设备受限于阵列布局和麦克风数量。本文提出一种基于球谐波波束成形的全向声学编码与上采样方法（SHB-AE），适用于智能手机麦克风阵列（SPMA）。通过根据阵列流形设计每阶球谐函数对应的波束成形器，该方法实现了全向声学编码与上采样。在真实SPMA及其模拟自由场对应物上进行验证，结果表明：在噪声与混响条件下，仅使用四个不规则排列的麦克风即可成功编码并上采样至第四阶全向声学信号。
原文摘要 · Abstract (English)
With the rapid development of virtual reality (VR) and augmented reality (AR), spatial audio recording and reproduction have gained increasing research interest. Higher Order Ambisonics (HOA) stands out for its adaptability to various playback devices and its ability to integrate head orientation. However, current HOA recordings often rely on bulky spherical microphone arrays (SMA), and portable devices like smartphones are limited by array configuration and number of microphones. We propose SHB-AE, a spherical harmonic beamforming based method for Ambisonics encoding using a smartphone microphone array (SPMA). By designing beamformers for each order of spherical harmonic functions based on the array manifold, the method enables Ambisonics encoding and up-scaling. Validation on a real SPMA and its simulated free-field counterpart in noisy and reverberant conditions showed that the method successfully encodes and up-scales Ambisonics up to the fourth order with just four irregularly arranged microphones.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。