arXiv:2602.15491cs.SDcs.AI2026-02

将音频信号分解为增益与形状,提升神经音频编码效率

The Equalizer: Introducing Shape-Gain Decomposition in Neural Audio Codecs

  • 输入信号先拆分为增益和归一化形状,分别处理
  • 比特率-失真性能显著提升,量化复杂度大幅降低
  • 通用方法,适配各类神经音频编码器

神经音频编码器(NAC)通常将语音/音频信号的短时能量(增益)和归一化结构(形状)联合编码于同一潜在空间,导致对输入信号整体电平变化鲁棒性差,此类变化会强烈影响编码器输出嵌入向量及其量化结果。该方法本质上效率低下,造成码本冗余及次优的比特率-失真表现。为此,本文提出将经典语音与音频编码中广泛使用的增益-形状分解引入NAC框架。所提Equalizer方法在任意NAC中均可应用:在编码器前,以短时为基础将输入信号分解为增益和归一化形状向量;形状向量交由NAC处理,增益则通过标量量化独立传输。解码端通过NAC输出的归一化信号与量化增益重建最终信号。在四种主流编码器上的实验表明,该通用方法显著提升比特率-失真性能,并大幅降低量化器复杂度。

原文摘要 · Abstract (English)

Neural audio codecs (NACs) typically encode the short-term energy (gain) and normalized structure (shape) of speech/audio signals jointly within the same latent space. As a result, they are poorly robust to a global variation of the input signal level in the sense that such a variation has a strong influence on the embedding vectors at the output of the encoder and their quantization. This methodology is inherently inefficient, leading to codebook redundancy and suboptimal bitrate-distortion performance. To address these limitations, we propose to introduce shape-gain decomposition, widely used in classical speech and audio coding, into the NAC framework. The principle of the proposed Equalizer methodology, easily applicable to any NAC, is to decompose the input signal---before the NAC encoder---into gain and normalized shape vector on a short-term basis. The shape vector is processed by the NAC, while the gain is quantized with scalar quantization and transmitted separately. The output (decoded) signal is reconstructed from the normalized output of the NAC and the quantized gain. Our experiments conducted on speech signals with four different prominent codecs show that this general methodology enables a substantial gain in bitrate-distortion performance, as well as a massive reduction in quantizer complexity.

音频编码神经编码增益分解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。