arXiv:2506.16231eess.AScs.SD2025-06中稿 · IEEE Transactions …被引 5

EDNet通过自适应门控机制融合降噪与重建,提升复杂噪声下的语音增强效果。

EDNet: A Versatile Speech Enhancement Framework with Gating Mamba Mechanism and Phase Shift-Invariant Training

  • 引入可学习门控的Mamba模块,动态选择掩蔽或映射策略
  • 采用相位移不变训练,提升相位估计精度并兼容标准损失函数
  • 在多种噪声、混响和带宽受限场景下表现稳定,适合实际应用

真实环境中的语音信号常受加性噪声、混响和带宽限制等多重失真影响,可能单独或组合出现。传统语音增强方法通常依赖掩蔽(抑制非语音成分)或映射(直接重构干净语音),各自在特定条件下有效但泛化能力有限。本文提出通用语音增强框架EDNet,无需预先假设任务或输入特性,即可应对多种失真。其核心包含两个部分:(1) 门控Mamba(GM)模块,通过可学习门控机制自适应融合掩蔽(擦除)与重建(绘制),根据局部信号特征动态选择策略;(2) 相位移不变训练(PSIT),一种对移位容忍的监督策略,在训练中实现动态对齐,同时兼容标准损失函数。在去噪、去混响、带宽扩展及多失真增强任务上的实验表明,EDNet在各类条件下均保持优异性能,验证了其架构灵活性与多场景适应性。

原文摘要 · Abstract (English)

Speech signals in real-world environments are frequently affected by various distortions such as additive noise, reverberation, and bandwidth limitation, which may appear individually or in combination. Traditional speech enhancement methods typically rely on either masking, which focuses on suppressing non-speech components while preserving observable structure, or mapping, which seeks to recover clean speech through direct transformation of the input. Each approach offers strengths in specific scenarios but may be less effective outside its target conditions. We propose the Erase and Draw Network (EDNet), a versatile speech enhancement framework designed to handle a broad range of distortion types without prior assumptions about task or input characteristics. EDNet consists of two main components: (1) the Gating Mamba (GM) module, which adaptively combines masking and mapping through a learnable gating mechanism that selects between suppression (Erase) and reconstruction (Draw) based on local signal features, and (2) Phase Shift-Invariant Training (PSIT), a shift tolerant supervision strategy that improves phase estimation by enabling dynamic alignment during training while remaining compatible with standard loss functions. Experimental results on denoising, dereverberation, bandwidth extension, and multi distortion enhancement tasks show that EDNet consistently achieves strong performance across conditions, demonstrating its architectural flexibility and adaptability to diverse task settings.

语音增强Mamba门控机制相位鲁棒

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。