arXiv:2507.09806eess.AScs.SD2025-07被引 2

用低秩微调让声场重建模型快速适应新声源位置。

Low-Rank Adaptation of Deep Prior Neural Networks For Room Impulse Response Reconstruction

  • 用低秩分解方式微调预训练网络,减少计算开销。
  • 仅换声源位置时,低秩微调保持高物理保真度。
  • 适合麦克风少、需快速适配新场景的声学应用。

Deep Prior 框架是一种强大的生成工具,可从少量稀疏声压测量中重建环境声场。它使用仅在有限数据上训练的神经网络作为隐式先验,引导优化问题求解。然而,该方法难以泛化到新的声学配置,如声源位置变化,导致每次新设置都需从头训练,计算成本高且耗时。为此,本文研究通过低秩适应(LoRA)实现 Deep Prior 的迁移学习,通过引入可训练参数的低秩分解,实现对预训练网络的高效微调,从而以极小计算开销适应新测量集。我们将 LoRA 嵌入 MultiResUNet-based Deep Prior 模型,在仅使用少量麦克风的场景下,对比了全参数微调与传统重训的性能。结果表明,无论完全微调或采用 LoRA 微调,在仅声源位置变化时均表现优异,能保持高物理保真度,凸显迁移学习在声学应用中的价值。

原文摘要 · Abstract (English)

The Deep Prior framework has emerged as a powerful generative tool which can be used for reconstructing sound fields in an environment from few sparse pressure measurements. It employs a neural network that is trained solely on a limited set of available data and acts as an implicit prior which guides the solution of the underlying optimization problem. However, a significant limitation of the Deep Prior approach is its inability to generalize to new acoustic configurations, such as changes in the position of a sound source. As a consequence, the network must be retrained from scratch for every new setup, which is both computationally intensive and time-consuming. To address this, we investigate transfer learning in Deep Prior via Low-Rank Adaptation (LoRA), which enables efficient fine-tuning of a pre-trained neural network by introducing a low-rank decomposition of trainable parameters, thus allowing the network to adapt to new measurement sets with minimal computational overhead. We embed LoRA into a MultiResUNet-based Deep Prior model and compare its adaptation performance against full fine-tuning of all parameters as well as classical retraining, particularly in scenarios where only a limited number of microphones are used. The results indicate that fine-tuning, whether done completely or via LoRA, is especially advantageous when the source location is the sole changing parameter, preserving high physical fidelity, and highlighting the value of transfer learning for acoustics applications.

声场重建低秩微调迁移学习音频处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。