arXiv:2410.02640eess.IVcs.CV2024-10被引 20

用压缩特征启动扩散模型,提速并提升极端图像压缩画质。

RDEIC: Accelerating Diffusion-Based Extreme Image Compression with Relay Residual Diffusion

  • 用带噪声的压缩特征替代纯噪声作为扩散起点。
  • 提出残差扩散方程,同时去除噪声与压缩误差。
  • 固定步数微调提升训练推理一致性,适合高效压缩场景。

基于扩散模型的极端图像压缩在极低码率下表现优异,但受限于从纯噪声开始的迭代去噪过程,在保真度和效率上仍存瓶颈。为此,本文提出中继残差扩散极端图像压缩(RDEIC),通过压缩特征初始化和残差扩散机制实现突破。首先,以添加噪声的压缩潜在特征为起始点,跳过冗余的初始去噪阶段;其次,从Stable Diffusion原扩散方程推导出新型残差扩散方程,通过迭代移除添加噪声及压缩特征与目标特征间的残差,重建原始图像;第三,设计固定步数微调策略,消除训练与推理阶段差异,进一步提升重建质量。大量实验表明,RDEIC在保真度与效率上均优于现有基于扩散的极端图像压缩方法。代码与预训练模型已公开于https://github.com/huai-chang/RDEIC。

原文摘要 · Abstract (English)

Diffusion-based extreme image compression methods have achieved impressive performance at extremely low bitrates. However, constrained by the iterative denoising process that starts from pure noise, these methods are limited in both fidelity and efficiency. To address these two issues, we present Relay Residual Diffusion Extreme Image Compression (RDEIC), which leverages compressed feature initialization and residual diffusion. Specifically, we first use the compressed latent features of the image with added noise, instead of pure noise, as the starting point to eliminate the unnecessary initial stages of the denoising process. Second, we directly derive a novel residual diffusion equation from Stable Diffusion's original diffusion equation that reconstructs the raw image by iteratively removing the added noise and the residual between the compressed and target latent features. In this way, we effectively combine the efficiency of residual diffusion with the powerful generative capability of Stable Diffusion. Third, we propose a fixed-step fine-tuning strategy to eliminate the discrepancy between the training and inference phases, thereby further improving the reconstruction quality. Extensive experiments demonstrate that the proposed RDEIC achieves state-of-the-art visual quality and outperforms existing diffusion-based extreme image compression methods in both fidelity and efficiency. The source code and pre-trained models are available at https://github.com/huai-chang/RDEIC.

图像压缩扩散模型残差扩散高效编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。