一歩で画像の圧縮アーティファクトを除去する新モデル
Compression-Aware One-Step Diffusion Model for JPEG Artifact Removal
- 圧縮情報を利用した埋め込み機構で、1ステップの拡散モデルを構築
- 高圧縮画像でも従来手法を上回る復元品質(数値で確認)
- 実用化に適した高速処理、画像修復研究者におすすめ
扩散模型在图像修复任务中表现出色,但其多步去噪过程带来显著计算开销,限制了实际部署。此外,现有方法难以有效去除严重压缩的JPEG伪影,尤其在高压缩图像上表现不佳。为此,我们提出CODiff,一种面向JPEG伪影去除的压缩感知一步扩散模型。CODiff的核心是压缩感知视觉嵌入器(CaVE),可提取并利用JPEG压缩先验信息以指导扩散过程。我们提出双学习策略,结合显式与隐式学习:显式学习通过质量预测目标区分不同压缩等级的低质图像;隐式学习采用重建目标提升模型泛化能力。该双学习机制使模型对JPEG压缩有更深入、全面的理解。实验表明,CODiff在定量与视觉质量指标上均优于近期领先方法。代码已开源:https://github.com/jp-guo/CODiff。
原文摘要 · Abstract (English)
Diffusion models have demonstrated remarkable success in image restoration tasks. However, their multi-step denoising process introduces significant computational overhead, limiting their practical deployment. Furthermore, existing methods struggle to effectively remove severe JPEG artifact, especially in highly compressed images. To address these challenges, we propose CODiff, a compression-aware one-step diffusion model for JPEG artifact removal. The core of CODiff is the compression-aware visual embedder (CaVE), which extracts and leverages JPEG compression priors to guide the diffusion model. We propose a dual learning strategy that combines explicit and implicit learning. Specifically, explicit learning enforces a quality prediction objective to differentiate low-quality images with different compression levels. Implicit learning employs a reconstruction objective that enhances the model's generalization. This dual learning allows for a deeper and more comprehensive understanding of JPEG compression. Experimental results demonstrate that CODiff surpasses recent leading methods in both quantitative and visual quality metrics. The code is released at https://github.com/jp-guo/CODiff.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。