动态调整空间音频等级,实现远程音乐演出的沉浸与稳定兼顾
Dynamic Real-Time Ambisonics Order Adaptation for Immersive Networked Music Performances
- 根据网络带宽实时调节空间音频阶数,避免卡顿
- 带宽不足时自动降阶,恢复后迅速回升,保障连续性
- 适合对音质和延迟敏感的远程音乐协作场景
远程音乐表演(NMP)等高级应用需保证用户间沉浸式、近似真实世界的交互体验。采用空间音频格式如Ambisonics是实现沉浸声场的关键。然而,高阶Ambisonics虽能提升声场还原精度,但会增加音频通道数量,导致带宽需求上升,并加剧网络延迟、抖动和丢包等问题,严重影响互动性。为此,本文提出一种实时自适应高阶Ambisonics策略,持续监测网络吞吐量,动态调整编码阶数。当带宽低于阈值时自动降阶以防止音频中断;条件恢复后立即回升至高阶,实现沉浸感与可靠性的平衡。基于MUSHRA的评估表明,该方法在带宽受限的NMP场景中具有显著潜力。
原文摘要 · Abstract (English)
Advanced remote applications such as Networked Music Performance (NMP) require solutions to guarantee immersive real-world-like interaction among users. Therefore, the adoption of spatial audio formats, such as Ambisonics, is fundamental to let the user experience an immersive acoustic scene. The accuracy of the sound scene reproduction increases with the order of the Ambisonics enconding, resulting in an improved immersivity at the cost of a greater number of audio channels, which in turn escalates both bandwidth requirements and susceptibility to network impairments (e.g., latency, jitter, and packet loss). These factors pose a significant challenge for interactive music sessions, which demand high spatial fidelity and low end-to-end delay. We propose a real-time adaptive higher-order Ambisonics strategy that continuously monitors network throughput and dynamically scales the Ambisonics order. When available bandwidth drops below a preset threshold, the order is lowered to prevent audio dropouts; it then reverts to higher orders once conditions recover, thus balancing immersion and reliability. A MUSHRA-based evaluation indicates that this adaptive approach is promising to guarantee user experience in bandwidth-limited NMP scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。