arXiv:2512.07192cs.CV2025-12

用连续嵌入空间建模概率,让生成式图像压缩更高效、可优化。

HyperVQ: Enabling Hyperprior Entropy Modeling for VQ-Based Generative Image Compression

  • 将概率建模从离散索引转到连续嵌入空间,实现自适应熵编码
  • 在多种VQ架构上平均节省18.5%码率,是传统霍夫曼编码的7.28倍
  • 支持端到端率失真优化,适合需要高效率的生成式压缩场景

基于向量量化(VQ)的生成式图像压缩在主观质量上表现优异,但现有方法存在两大根本局限:一是缺乏高效的自适应熵建模,依赖静态频率导致编码效率低;二是离散索引与连续先验之间的固有冲突,阻碍了真正的端到端率失真(RD)联合优化。为此,我们提出HyperVQ,一个为VQ编码器构建高性能超先验熵建模框架的原理性方案。其核心思想是将概率建模完全转移到连续嵌入空间中:不直接预测离散符号的概率,而是对连续潜在变量预测高维多变量高斯分布。通过将离散码本条目视为该空间中的固定“锚点”,依据相对距离将连续高斯密度转化为类别索引概率。这一优雅形式提供了一个强大的、空间自适应的熵引擎,并使交叉熵率目标完全可微,从而在网络训练中主动动态优化率失真权衡。为确保实用性,我们设计了轻量级的H Block和概率估计引擎(PEE),实现高度并行、毫秒级推理。实验表明,HyperVQ作为通用模块,适用于多种VQ架构(单尺度、大码本、RVQ),平均码率降低18.5%,是传统霍夫曼编码提升效果的7.28倍。这为下一代生成式图像压缩建立了稳健、可调控的率失真基础。

原文摘要 · Abstract (English)

Vector Quantization (VQ) based generative image compression has achieved remarkable perceptual quality. However, existing VQ codecs suffer from two fundamental limitations. First, they lack efficient content-adaptive entropy modeling and rely on static frequencies, leading to low coding efficiency. Second, the inherent conflict between discrete indices and continuous priors prevents true end-to-end joint Rate-Distortion (RD) optimization. To resolve these issues, we propose HyperVQ, a principled framework that establishes a high-performance hyperprior entropy foundation for VQ-based codecs. The core insight of HyperVQ is to shift probability modeling entirely into the continuous embedding space. Instead of directly predicting probabilities for discrete symbols, HyperVQ predicts a high-dimensional continuous multivariate Gaussian distribution for the continuous latents. By treating the discrete codebook entries as fixed "anchors" in this space, we convert the continuous Gaussian density into categorical index probabilities based on relative distances. This elegant formulation provides a powerful, spatially-adaptive entropy engine and renders the cross-entropy rate objective fully differentiable, empowering the network to actively and dynamically optimize the RD trade-off during training. To ensure practicality, we design the lightweight H Block and the Probability Estimation Engine (PEE) to facilitate highly parallel, millisecond-level inference. Experiments demonstrate that HyperVQ acts as a universal module across diverse VQ architectures (single-scale, large-codebook, RVQ), achieving an average bitrate saving of 18.5%, which is 7.28x the saving achieved by conventional Huffman coding. This establishes a robust, RD-controllable foundation for next-generation generative image compression.

图像压缩向量量化熵建模生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。