提出一种可灵活调节画质与感知真实性的图像压缩方法。
Dual-Constrained Diffusion Image Compression for Operational Rate-Distortion-Perception Optimization

- 用双重约束控制扩散解码,实现画质与真实感协同优化。
- 单比特流支持连续调节,关键参数组合达最优性能。
- 适合需要精细控制视觉质量的图像压缩应用。
率-失真-感知(RDP)权衡扩展了经典率-失真理论,通过施加重建分布约束,为神经图像压缩提供统一框架,同时调控保真度与感知真实性。尽管已有工作实现接近最优的率-感知权衡,但能实际实现完整RDP曲面的框架仍稀少,主因是解码端引入共同随机性困难。本文提出DCIC(双约束扩散图像压缩),将学习型编解码器与基于扩散的解码器结合,受失真与幂等性双重约束。失真约束限制重建结果相对于基础编码输出的保真度;幂等性约束要求重编码恢复原始编码输出,作为分布感知要求的可计算替代。二者联合引导逆向去噪过程,通过迭代优化与一致噪声注入,实现无需额外率开销的共同随机性。在固定码率下,双衰减因子(K_D, K_P)共同导航失真-感知平面的帕累托前沿,实现单一比特流下的连续可调画质-真实感权衡。DCIC_RD(K_P=0)与DCIC_RP(K_D=0)为边界曲线,而DCIC_RDP(K_D=K_P=1)实现最优内部操作点。在CelebA-HQ、CLIC2020与ImageNet-1K数据集上,涵盖CNN、Transformer及混合架构的实验表明,DCIC_RDP在所有感知编码中均取得更优的BD-PSNR,DCIC_RP在BD-FID上匹配专用感知优化方法,验证了全RDP曲面导航的实际价值。
原文摘要 · Abstract (English)
The rate-distortion-perception (RDP) trade-off extends classical rate--distortion theory by imposing a distributional constraint on reconstructions, providing a unified framework for neural image compression that jointly governs fidelity and perceptual realism. While prior work achieves near-optimal rate--perception trade-offs, practical frameworks explicitly realizing the full RDP surface remain scarce, primarily due to the difficulty of introducing common randomness at the decoder. We propose DCIC (Dual-Constrained Diffusion Image Compression), which integrates a learned codec with a diffusion-based decoder governed by joint distortion and idempotence constraints. The distortion constraint bounds reconstruction fidelity relative to the base codec output; the idempotence constraint -- requiring that re-encoding the restored image recovers the base codec reconstruction -- serves as a tractable surrogate for the distributional perception requirement. Together, they steer the reverse denoising process via iterative optimization with consistent noise injection, realizing common randomness without additional rate overhead. At fixed rate, dual attenuation factors $(K_D, K_P)$ jointly navigate the Pareto frontier of the distortion-perception plane, enabling continuously adjustable fidelity-realism trade-offs from a single bitstream. DCIC$_{RD}$ ($K_P{=}0$) and DCIC$_{RP}$ ($K_D{=}0$) arise as boundary curves, with DCIC$_{RDP}$ ($K_D = K_P=1$) realizing the optimal interior operating point. Experiments on CelebA-HQ, CLIC2020, and ImageNet-1K across CNN, Transformer, and hybrid architectures confirm that DCIC$_{RDP}$ achieves superior BD-PSNR over all perceptual codecs, while DCIC$_{RP}$ matches dedicated perception-oriented methods in BD-FID, validating the practical value of full RDP surface navigation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。