arXiv:2506.21977eess.IVcs.CV2025-06ICCV被引 29

用一步扩散实现超低码率图像压缩,兼顾高保真与高真实感。

StableCodec: Taming One-Step Diffusion for Extreme Image Compression

论文配图:StableCodec: Taming One-Step Diffusion for Extreme Image Compression
图 1 · 摘自论文原文
  • 采用单步去噪与双分支编码结构,提升压缩效率与重建质量。
  • 在0.005比特/像素下仍保持优异的FID、KID和DISTS指标。
  • 适合实时图像压缩场景,推理速度媲美主流变换编码方法。

基于扩散模型的图像压缩在极低码率(低于0.05比特/像素)下展现出生成高真实感图像的巨大潜力,但现有方法需大量去噪步骤才能生成高质量结果,难以满足实时压缩需求。同时,扩散模型常无法保证像素级一致性,导致重建失真。为此,我们提出StableCodec,实现高保真、高真实感的极端图像压缩。首先设计高效的深度压缩潜变量编码器,传输噪声潜变量以支持单步去噪;其次引入双分支编码结构,通过辅助编解码器增强重建保真度;最后采用端到端优化,联合约束码率与像素级损失。在CLIC 2020、DIV2K和Kodak数据集上的实验表明,StableCodec在低至0.005比特/像素的码率下,显著优于现有方法,各项指标(FID、KID、DISTS)均表现优异,且推理速度与主流变换编码相当。代码已开源。

原文摘要 · Abstract (English)

Diffusion-based image compression has shown remarkable potential for achieving ultra-low bitrate coding (less than 0.05 bits per pixel) with high realism, by leveraging the generative priors of large pre-trained text-to-image diffusion models. However, current approaches require a large number of denoising steps at the decoder to generate realistic results under extreme bitrate constraints, limiting their application in real-time compression scenarios. Additionally, these methods often sacrifice reconstruction fidelity, as diffusion models typically fail to guarantee pixel-level consistency. To address these challenges, we introduce StableCodec, which enables one-step diffusion for high-fidelity and high-realism extreme image compression with improved coding efficiency. To achieve ultra-low bitrates, we first develop an efficient Deep Compression Latent Codec to transmit a noisy latent representation for a single-step denoising process. We then propose a Dual-Branch Coding Structure, consisting of a pair of auxiliary encoder and decoder, to enhance reconstruction fidelity. Furthermore, we adopt end-to-end optimization with joint bitrate and pixel-level constraints. Extensive experiments on the CLIC 2020, DIV2K, and Kodak dataset demonstrate that StableCodec outperforms existing methods in terms of FID, KID and DISTS by a significant margin, even at bitrates as low as 0.005 bits per pixel, while maintaining strong fidelity. Additionally, StableCodec achieves inference speeds comparable to mainstream transform coding schemes. All source code are available at https://github.com/LuizScarlet/StableCodec.

图像压缩扩散模型单步去噪高保真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。