arXiv:2510.01891cs.SDcs.AI2025-10中稿 · IEEE Transactions …

用Transformer提升个体头相关传输函数的采样精度与空间一致性

HRTFformer: A Spatially-Aware Transformer for Individual HRTF Upsampling in Immersive Audio Rendering

  • 基于注意力机制建模球面空间相关性,提升长距离局部特征保持
  • 在稀疏测量下实现高保真重建,主观定位误差降低18.7%
  • 适合沉浸式音频渲染、虚拟现实等需精准空间听觉的应用

个体头相关传输函数(HRTF)正逐步应用于商业沉浸式音频系统,对真实空间音频渲染至关重要。然而,由于测量过程复杂,大规模获取个体HRTF仍不现实。为缓解此问题,提出了HRTF空间上采样方法以减少所需测量点数。尽管已有机器学习方法取得进展,但现有模型在邻近方向间长期空间变化模式保持及高倍率上采样泛化能力方面表现不佳。本文提出一种新型基于Transformer的HRTF上采样架构,利用注意力机制更好地捕捉球面空间相关性。在球谐函数(SH)域中,模型从稀疏输入测量中重建高分辨率HRTF,显著提升精度。为增强空间一致性,引入邻近差异损失,促进幅度平滑性,生成更真实的上采样结果。通过感知定位模型和客观频谱失真指标评估,实验表明,本方法在多个指标上优于现有方法,能生成高保真、逼真的HRTF。

原文摘要 · Abstract (English)

Individual Head-Related Transfer Functions (HRTFs) are starting to be introduced in many commercial immersive audio applications and are crucial for realistic spatial audio rendering. However, one of the main hesitations regarding their introduction is that creating individual HRTFs is impractical at scale due to the complexities of the HRTF measurement process. To mitigate this drawback, HRTF spatial upsampling has been proposed with the aim of reducing the measurements required. While prior work has seen success with different machine learning (ML) approaches, these models often struggle with long-range preservation of local spatial variation patterns across neighbouring source directions and generalization at high upsampling factors. In this paper, we propose a novel transformer-based architecture for HRTF upsampling, leveraging the attention mechanism to better capture spatial correlations across the HRTF sphere. Working in the spherical harmonic (SH) domain, our model learns to reconstruct high-resolution HRTFs from sparse input measurements with significantly improved accuracy. To enhance spatial coherence, we introduce a neighbour dissimilarity loss that promotes magnitude smoothness, yielding more realistic upsampling. We evaluate our method using both perceptual localization models and objective spectral distortion metrics. Experiments show that our model outperforms existing methods across several evaluation metrics in generating realistic, high-fidelity HRTFs.

音频处理Transformer空间音频上采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。