arXiv:2412.19099cs.SDeess.AS2024-12中稿 · AAAI被引 6

分离音量与相位处理,用轻量模块提升单声道语音增强效果

BSDB-Net: Band-Split Dual-Branch Network with Selective State Spaces Mechanism for Monaural Speech Enhancement

  • 双分支并行处理音量和相位,解耦避免信息补偿损失
  • 频带分割+Mamba模块,计算量比传统模型降低8.3倍
  • 适合资源受限场景,尤其对实时语音增强有帮助

尽管基于复数谱的语音增强方法已取得显著性能,但幅度与相位的耦合会导致补偿效应,即为弥补有害相位而牺牲幅度信息。此外,为提升性能叠加大量模块,导致模型复杂度上升,限制实际应用。为此,本文提出一种基于压缩频域的双路径网络,采用Mamba架构。首先,通过并行双分支提取幅度与相位信息,利用结构化复数谱隐式捕捉相位,并通过交互模块抑制冗余成分、从另一分支恢复缺失信息,从而解决补偿问题。其次,引入频带分割策略压缩频率维度;进一步设计基于Mamba的模块,在线性复杂度下建模时频维度。相比基线模型,本方法实现平均8.3倍计算量降低,相较基于Transformer的模型更是减少25倍。

原文摘要 · Abstract (English)

Although the complex spectrum-based speech enhancement(SE) methods have achieved significant performance, coupling amplitude and phase can lead to a compensation effect, where amplitude information is sacrificed to compensate for the phase that is harmful to SE. In addition, to further improve the performance of SE, many modules are stacked onto SE, resulting in increased model complexity that limits the application of SE. To address these problems, we proposed a dual-path network based on compressed frequency using Mamba. First, we extract amplitude and phase information through parallel dual branches. This approach leverages structured complex spectra to implicitly capture phase information and solves the compensation effect by decoupling amplitude and phase, and the network incorporates an interaction module to suppress unnecessary parts and recover missing components from the other branch. Second, to reduce network complexity, the network introduces a band-split strategy to compress the frequency dimension. To further reduce complexity while maintaining good performance, we designed a Mamba-based module that models the time and frequency dimensions under linear complexity. Finally, compared to baselines, our model achieves an average 8.3 times reduction in computational complexity while maintaining superior performance. Furthermore, it achieves a 25 times reduction in complexity compared to transformer-based models.

语音增强Mamba双分支轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。