无需参考图,用扩散模型修复光照退化图像。
ZeroIDIR: Zero-Reference Illumination Degradation Image Restoration with Perturbed Consistency Diffusion Models

- 分两步:先自适应校正光照,再用扰动一致性扩散重建细节。
- 在无监督条件下性能超越现有方法,接近有监督水平。
- 适合处理各类光照异常的低质量图像修复任务。
本文提出一种零参考扩散框架ZeroIDIR,用于光照退化图像恢复。该方法将恢复过程解耦为自适应光照校正与基于扩散的重建,仅使用低质量退化图像进行训练。设计自适应伽马校正模块,实现空间变化的曝光修正,生成仅含光照校正的表征,以缓解曝光偏差,并作为后续扩散过程的可靠输入;引入直方图引导的光照校正损失,使校正后的光照分布逼近自然场景。随后,将光照校正后的图像视为扰动一致性扩散模型的中间噪声状态,以重建细节并抑制噪声。此外,提出扰动扩散一致性损失,约束最终恢复图像的前向扩散轨迹与扰动状态保持一致,从而提升无监督条件下的恢复保真度与稳定性。在多个公开基准上的大量实验表明,该方法优于现有无监督先进方法,且性能可媲美有监督方法,对不同场景更具泛化性。代码已开源。
原文摘要 · Abstract (English)
In this paper, we propose a zero-reference diffusion-based framework, named ZeroIDIR, for illumination degradation image restoration, which decouples the restoration process into adaptive illumination correction and diffusion-based reconstruction while being trained solely on low-quality degraded images. Specifically, we design an adaptive gamma correction module that performs spatially varying exposure correction to generate illumination-corrected only representations to mitigate exposure bias and serve as reliable inputs for subsequent diffusion processes, where a histogram-guided illumination correction loss is introduced to regularize the corrected illumination distribution toward that of natural scenes. Subsequently, the illumination-corrected image is treated as an intermediate noisy state for the proposed perturbed consistency diffusion model to reconstruct details and suppress noise. Moreover, a perturbed diffusion consistency loss is proposed to constrain the forward diffusion trajectory of the final restored image to remain consistent with the perturbed state, thus improving restoration fidelity and stability in the absence of supervision. Extensive experiments on publicly available benchmarks show that the proposed method outperforms state-of-the-art unsupervised competitors and is comparable to supervised methods while being more generalizable to various scenes. Code is available at https://github.com/JianghaiSCU/ZeroIDIR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。