用量化噪声建模扩散过程,提升图像压缩保真度。
A Noise Constrained Diffusion (NC-Diffusion) Framework for High Fidelity Image Compression

- 将压缩中的量化噪声作为扩散前向过程的噪声源
- 在多个数据集上实现最优保真度,显著提升解码效率
- 适合追求高保真图像压缩的研究者与工程师
由于扩散模型在学习过程中引入随机噪声,现有基于扩散的图像压缩方法通常会产生与原始图像有偏差的重建结果,导致压缩性能不佳。为此,本文提出一种噪声约束扩散(NC-Diffusion)框架,用于高保真图像压缩。不同于以往方法在扩散过程中添加随机高斯噪声并引导其进入图像空间的做法,本方法将学习到的图像压缩中原本加入的量化噪声定义为扩散前向过程的噪声。进而从真实图像构建一个从真实图像到带量化噪声的初始压缩结果的噪声约束扩散过程。该方法有效解决了压缩与扩散阶段之间的噪声不匹配问题,显著提升了推理效率。此外,设计了自适应频域滤波模块,增强基于U-Net的扩散架构中的跳跃连接以保留高频细节;还提出了零样本样本引导增强方法,进一步提升图像保真度。在多个基准数据集上的实验表明,本方法在性能上优于现有方法。
原文摘要 · Abstract (English)
With the great success of diffusion models in image generation, diffusion-based image compression is attracting increasing interests. However, due to the random noise introduced in the diffusion learning, they usually produce reconstructions with deviation from the original images, leading to suboptimal compression results. To address this problem, in this paper, we propose a Noise Constrained Diffusion (NC-Diffusion) framework for high fidelity image compression. Unlike existing diffusion-based compression methods that add random Gaussian noise and direct the noise into the image space, the proposed NC-Diffusion formulates the quantization noise originally added in the learned image compression as the noise in the forward process of diffusion. Then a noise constrained diffusion process is constructed from the ground-truth image to the initial compression result generated with quantization noise. The NC-Diffusion overcomes the problem of noise mismatch between compression and diffusion, significantly improving the inference efficiency. In addition, an adaptive frequency-domain filtering module is developed to enhance the skip connections in the U-Net based diffusion architecture, in order to enhance high-frequency details. Moreover, a zero-shot sample-guided enhancement method is designed to further improve the fidelity of the image. Experiments on multiple benchmark datasets demonstrate that our method can achieve the best performance compared with existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。