用扩散模型先验提升曝光校正质量,尤其改善极端过曝区域细节。
High-Quality Exposure Correction with Diffusion-Based Image Generation Priors

- 基于预训练扩散模型,通过单步去噪生成高质量图像。
- 在多个数据集上超越现有方法,显著提升视觉感知质量和细节保留。
- 适合需要高保真与自然视觉效果的图像修复与增强场景。
现有曝光校正方法虽保持高像素级保真度,但过度关注整体像素精度,难以有效建模极端曝光区域,导致感知质量不佳。近期扩散模型在图像生成中表现突出,但其在曝光校正中的应用仍具挑战,核心难题在于随机扩散过程中如何准确生成图像结构并维持高保真度。本文提出DPEC(Diffusion Prior-based Exposure Correction),利用预训练大规模扩散模型中的图像生成先验进行曝光校正。首先设计高效微调策略,从预训练模型中提取曝光校正器,实现在单步去噪过程中的图像增强;其次,融合扩散模型与回归模型优势,设计联合交叉注意力模块,整合多尺度扩散先验特征,有效保留高频细节并减少随机伪影。扩散模型专注于低频内容处理,而非所有纹理细节。实验表明,DPEC在多个曝光校正数据集上持续优于现有最先进方法,无论在保真度、感知质量还是视觉效果方面均表现更优。
原文摘要 · Abstract (English)
Although most existing exposure correction methods achieve high fidelity, they often place excessive focus on overall pixel-wise accuracy, making it challenging to effectively model extreme exposure regions, which results in suboptimal perceptual quality. Recently, diffusion models have received significant attention due to their remarkable performance in the realm of image generation. However, their successful application to exposure correction remains a challenging and open question. The key challenge lies in generating accurate image structures and maintaining high image fidelity during stochastic diffusion processes. In this paper, we propose DPEC (Diffusion Prior-based Exposure Correction), a novel framework for image exposure correction that utilizes diffusion-based image generation priors encapsulated in pre-trained large-scale diffusion models. Specifically, we first propose an efficient fine-tuning strategy to derive an exposure corrector from pre-trained models, enabling the generation of enhanced images in a single-step denoising process. Moreover, we seamlessly combine the strengths of diffusion models and regression models, and design a joint cross-attention module to integrate multi-scale diffusion prior features, thereby effectively preserving high-frequency details and minimizing random artifacts. The diffusion model focuses on dealing with low-frequency content rather than all the intricate texture details. The experimental results demonstrate that the proposed DPEC method consistently outperforms existing state-of-the-art methods on multiple exposure correction datasets, whether in terms of fidelity, perceptual quality, or visual effects.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。