提出快速零样本扩散图像压缩方法,速度远超现有技术。
Turbo-DDCM: Fast and Flexible Zero-Shot Diffusion-Based Image Compression
- 通过合并多个噪声向量减少去噪步骤,提升压缩效率
- 在相同码率下,性能媲美当前最优方法(如在CLIC2023上达到2.76bpp)
- 支持区域优先与目标保真度压缩,适用性强
尽管近年来零样本扩散图像压缩取得了显著进展,但其仍以速度慢、计算开销大著称。本文提出一种高效零样本扩散压缩方法Turbo-DDCM,相比现有方法运行速度快得多,同时保持与顶尖技术相当的性能。该方法基于最近提出的去噪扩散代码本模型(DDCM),其通过从可重现的随机代码本中逐次选取扩散噪声向量,引导去噪器重建目标图像。我们对这一框架进行改进,使每个去噪步骤能高效组合大量噪声向量,从而大幅减少所需去噪操作次数。该改进还结合了优化的编码协议。此外,我们引入两种灵活变体:一种是优先处理用户指定区域的版本,另一种是根据目标峰值信噪比(PSNR)而非比特率进行压缩的版本。全面实验表明,Turbo-DDCM是一种高效、实用且灵活的图像压缩方案。
原文摘要 · Abstract (English)
While zero-shot diffusion-based compression methods have seen significant progress in recent years, they remain notoriously slow and computationally demanding. This paper presents an efficient zero-shot diffusion-based compression method that runs substantially faster than existing methods, while maintaining performance that is on par with the state-of-the-art techniques. Our method builds upon the recently proposed Denoising Diffusion Codebook Models (DDCMs) compression scheme. Specifically, DDCM compresses an image by sequentially choosing the diffusion noise vectors from reproducible random codebooks, guiding the denoiser's output to reconstruct the target image. We modify this framework with Turbo-DDCM, which efficiently combines a large number of noise vectors at each denoising step, thereby significantly reducing the number of required denoising operations. This modification is also coupled with an improved encoding protocol. Furthermore, we introduce two flexible variants of Turbo-DDCM, a priority-aware variant that prioritizes user-specified regions and a distortion-controlled variant that compresses an image based on a target PSNR rather than a target BPP. Comprehensive experiments position Turbo-DDCM as a compelling, practical, and flexible image compression scheme.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。