arXiv:2505.16404eess.AScs.SD2025-05

用GAN扩展语音编码带宽,提升音质且适配多种编码器。

UBGAN: Enhancing Coded Speech with Blind and Guided Bandwidth Extension

  • 基于子带GAN的模块化设计,可将8kHz语音扩展至16kHz。
  • 引导版在极低附加码率下传输学习表征,盲版无需额外信息。
  • 跨编码器、跨码率通用,主观评测表现更优。

在实际语音编码应用中,无线信道质量、硬件限制或用户体验需求常需在感知质量、码率和计算复杂度之间权衡。多数传统与神经语音编码器以宽带(WB)信号为输入以达成平衡。为进一步提升编码语音的感知质量,带宽扩展(BWE)是传统语音编码中的热门技术。相比之下,神经语音编码器通常端到端训练于特定要求,难以适应变化,尤其常固定于单一采样率。本文提出通用带宽扩展生成对抗网络(UBGAN),一种模块化且轻量的GAN方案,显著提升多种传统与神经编码器的操作灵活性。模型在子带域工作,将8 kHz宽带信号扩展至16 kHz,生成超宽带(SWB)信号。我们引入两种变体:引导-UBGAN在极低码率下传输量化学习表征作为侧信息,而盲式-UBGAN无需此类信息。主观评估表明,UBGAN应用于WB编码器时具有明显优势,并验证了方法在多编码器与多码率下的泛化能力。

原文摘要 · Abstract (English)

In practical application of speech codecs, a multitude of factors such as the quality of the radio connection, limiting hardware or required user experience necessitate trade-offs between achievable perceptual quality, engendered bitrate and computational complexity. Most conventional and neural speech codecs operate on wideband (WB) speech signals to achieve this compromise. To further enhance the perceptual quality of coded speech, bandwidth extension (BWE) of the transmitted speech is an attractive and popular technique in conventional speech coding. In contrast, neural speech codecs are typically trained end-to-end to a specific set of requirements and are often not easily adaptable. In particular, they are typically trained to operate at a single fixed sampling rate. With the Universal Bandwidth Extension Generative Adversarial Network (UBGAN), we propose a modular and lightweight GAN-based solution that increases the operational flexibility of a wide range of conventional and neural codecs. Our model operates in the subband domain and extends the bandwidth of WB signals from 8 kHz to 16 kHz, resulting in super-wideband (SWB) signals. We further introduce two variants, guided-UBGAN and blind-UBGAN, where the guided version transmits quantized learned representation as a side information at a very low bitrate additional to the bitrate of the codec, while blind-BWE operates without such side-information. Our subjective assessments demonstrate the advantage of UBGAN applied to WB codecs and highlight the generalization capacity of our proposed method across multiple codecs and bitrates.

语音编码带宽扩展GAN音频生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。