arXiv:2505.16091eess.IVcs.CV2025-05NeurIPS被引 20

一拍即合:一张图多速率压缩,一步生成超清图像

OSCAR: One-Step Diffusion Codec Across Multiple Bit-rates

  • 将压缩残差视为扩散过程中的噪声状态,用单模型支持多比特率
  • 仅需一次去噪即可还原图像,推理速度提升数倍
  • 适合需要高效多分辨率图像压缩的系统部署

预训练潜在扩散模型在有损图像压缩中展现出强大潜力,依赖其强大的生成先验。现有基于扩散的方法通过迭代去噪从随机噪声重构图像,由压缩后的潜在表示引导。尽管重建质量高,但多步采样带来显著计算开销,且通常需为不同压缩比特率分别训练模型,导致训练和存储成本高昂。为此,我们提出跨多比特率的一步扩散编解码器OSCAR。具体地,将压缩潜在表示视为原始潜在的噪声变体,其失真程度取决于比特率,这一视角使其可建模为扩散轨迹中的中间状态。通过建立比特率到伪扩散时间步的映射,使单一生成模型支持多比特率重建。同时,我们认为压缩潜在仍保留丰富结构信息,使得一步去噪成为可能。因此,OSCAR以单次去噪替代迭代采样,大幅提升推理效率。大量实验表明,OSCAR在定量与视觉质量指标上均表现更优。代码与模型见https://github.com/jp-guo/OSCAR。

原文摘要 · Abstract (English)

Pretrained latent diffusion models have shown strong potential for lossy image compression, owing to their powerful generative priors. Most existing diffusion-based methods reconstruct images by iteratively denoising from random noise, guided by compressed latent representations. While these approaches have achieved high reconstruction quality, their multi-step sampling process incurs substantial computational overhead. Moreover, they typically require training separate models for different compression bit-rates, leading to significant training and storage costs. To address these challenges, we propose a one-step diffusion codec across multiple bit-rates. termed OSCAR. Specifically, our method views compressed latents as noisy variants of the original latents, where the level of distortion depends on the bit-rate. This perspective allows them to be modeled as intermediate states along a diffusion trajectory. By establishing a mapping from the compression bit-rate to a pseudo diffusion timestep, we condition a single generative model to support reconstructions at multiple bit-rates. Meanwhile, we argue that the compressed latents retain rich structural information, thereby making one-step denoising feasible. Thus, OSCAR replaces iterative sampling with a single denoising pass, significantly improving inference efficiency. Extensive experiments demonstrate that OSCAR achieves superior performance in both quantitative and visual quality metrics. The code and models are available at https://github.com/jp-guo/OSCAR.

图像压缩扩散模型多速率高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。