用二维网格量化音频特征,提升压缩效率与代码本利用率。
Two-Dimensional Quantization for Geometry-Aware Audio Coding
- 将特征对投影到六边形/菱形等二维网格上进行量化
- 在保持高重建质量的同时,降低令牌率并提升代码本使用率
- 适合追求高效音频编码的工程师与研究者
近期神经音频编解码器已实现优异的重建质量,通常依赖残差向量量化(RVQ)、向量量化(VQ)和有限标量量化(FSQ)等方法。然而这些量化技术限制了潜在空间的几何结构,难以捕捉特征间的相关性,导致表征学习、代码本利用和令牌率方面效率低下。本文提出二维量化(Q2D2),将特征对投影到六边形、菱形或矩形等结构化二维网格上,并量化至最近的网格点,隐式定义代码本,其大小与传统方法相当。尽管形式简单,Q2D2显著提升了音频压缩效率,在语音、音频和音乐等多个领域实验中表现优于或媲美现有最优模型,兼具低令牌率与高代码本利用率。
原文摘要 · Abstract (English)
Recent neural audio codecs have achieved impressive reconstruction quality, typically relying on quantization methods such as Residual Vector Quantization (RVQ), Vector Quantization (VQ) and Finite Scalar Quantization (FSQ). However, these quantization techniques limit the geometric structure of the latent space, make it harder to capture correlations between features leading to inefficiency in representation learning, codebook utilization and token rate. In this paper we introduce Two-Dimensional Quantization (Q2D2), a quantization scheme in which feature pairs are projected onto structured 2D grids, such as hexagonal, rhombic, or rectangular tiling and quantized to the nearest grid values, yielding an implicit codebook defined by the product of grid levels, with codebook sizes comparable to conventional methods. Despite its simple geometric formulation, Q2D2 improves audio compression efficiency, with low token rates and high codebook utilization while maintaining state of the art reconstruction quality. Specifically, Q2D2 achieves competitive to superior performance in various objective and subjective reconstruction metrics, across extensive experiments in speech, audio and music domains compared to state of the art models. Comprehensive ablation studies further confirm the effectiveness of our design choices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。