通过自适应融合先验提升低比特率图像生成压缩效果
Adaptive Fused Prior Transfer for Controllable Generative Image Compression

- 从预训练模型迁移自适应融合先验,解码器无需传输先验数据
- 在极低比特率下显著改善纹理和局部结构重建质量
- 适合需要高可控性与低延迟的图像压缩场景
学习型图像压缩已达到优异的率失真性能,但在极低比特率下重建仍困难,因传输表示难以保留细粒度纹理与局部结构。感知与生成式编解码器通过使用学习的重建先验解决此问题,可控编解码器则允许单个模型适应不同比特率与重建偏好。然而,可控性本身无法解决解码端的先验缺失问题:在严重比特约束下,解码器需从有限传输信息中推断缺失细节,而现有基于码本的可控设计通常依赖单一码本令牌先验。本文提出自适应融合先验传输方法(AFP-GIC),一种可控制的生成式图像压缩编解码器,其从冻结的预训练AdaCode模型中转移自适应融合先验。编码器侧融合先验特征指导潜在表示形成,解码器则从压缩表示与选定控制变量中预测兼容的融合先验,实现无需传输融合先验的先验引导重建。动机分析表明,解码端融合先验对齐与重建误差上界相关,且融合先验族包含单码本选择作为特例。在统一基准下,相比DC-VIC,AFP-GIC降低18.1%解码延迟,总参数量减少3110万(20.5%)。在Kodak、CLIC2020与DIV2K上的实验显示,其在峰值信噪比上表现相当,且在NIQE评分及极低比特率视觉对比中呈现最清晰的感知优势。
原文摘要 · Abstract (English)
Learned image compression has achieved competitive rate-distortion performance, but very-low-bitrate reconstruction remains difficult because the transmitted representation often cannot preserve fine textures and local structures. Perceptual and generative codecs address this problem by using learned reconstruction priors, and controllable codecs allow one model to cover different bitrate and reconstruction preferences. However, controllability alone does not resolve the decoder-side reconstruction-prior problem: under severe bit constraints, the decoder must infer missing details from limited transmitted information, while existing codebook-based controllable designs generally rely on single-codebook token-based priors. This paper proposes Adaptive Fused Prior Transfer for Controllable Generative Image Compression (AFP-GIC), a controllable codec that transfers an adaptive fused prior from a frozen pretrained AdaCode model. Encoder-side fused-prior features guide latent formation, while the decoder predicts a compatible fused prior from the compressed representation and selected control variables, enabling prior-guided reconstruction without transmitting the fused prior itself. A motivating analysis relates decoder-side fused-prior alignment to a reconstruction-error upper bound and shows that the fused-prior family contains single-codebook choices as special cases. Under the unified benchmark, AFP-GIC reduces decoder latency by 18.1% and the overall parameter count by 31.10 million (20.5%) relative to DC-VIC. Experiments on Kodak, CLIC2020, and DIV2K show competitive PSNR, with the clearest perceptual gains in NIQE scores and very-low-bitrate visual comparisons.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。