用单步扩散模型优化增益图,实现快速高动态范围成像
GMODiff: One-Step Gain Map Refinement with Diffusion Priors for HDR Reconstruction
- 将HDR重建转为增益图精修问题,仅需一步去噪
- 相比现有方法快100倍,且减少内容幻觉
- 适合追求速度与真实感的图像增强应用
预训练的潜在扩散模型(LDMs)在低层视觉任务中展现出强大的感知先验,为多曝光高动态范围(HDR)重建提供了新方向。然而,直接应用于HDR仍面临三大挑战:(1)8位潜在空间压缩导致动态范围受限;(2)多步去噪带来高昂推理成本;(3)生成式特性引发内容幻觉。为此,我们提出GMODiff,一种基于增益图驱动的一步扩散框架。不直接重建完整HDR图像,而是将HDR重建转化为降质感知的增益图(GM)精修问题,其中增益图编码扩展动态范围,但保持与LDR图像相同的位深。我们从基于回归的有信息量估计初始化去噪过程,而非纯噪声,使模型能在单步内生成高质量增益图。此外,鉴于回归模型擅长内容保真而LDM偏好感知质量,我们利用回归先验引导扩散去噪和潜在解码过程,抑制幻觉同时保留结构准确性。大量实验表明,GMODiff性能优于多个先进方法,且比先前基于LDM的方法快100倍。代码已开源:https://github.com/gbymat/GMODiff。
原文摘要 · Abstract (English)
Pre-trained Latent Diffusion Models (LDMs) have recently shown strong perceptual priors for low-level vision tasks, making them a promising direction for multi-exposure High Dynamic Range (HDR) reconstruction. However, directly applying LDMs to HDR remains challenging due to: (1) limited dynamic-range representation caused by 8-bit latent compression, (2) high inference cost from multi-step denoising, and (3) content hallucination inherent to their generative nature. To address these challenges, we introduce GMODiff, a gain map-driven one-step diffusion framework for multi-exposure HDR reconstruction. Instead of reconstructing full HDR content, we reformulate HDR reconstruction as a degradation-aware Gain Map (GM) refinement problem, where the GM encodes the extended dynamic range while retaining the same bit depth as LDR images. We initialize the denoising process from an informative regression-based estimate rather than pure noise, allowing the model to generate high-quality GMs in a single denoising step. Furthermore, recognizing that regression-based models excel in content fidelity while LDMs favor perceptual quality, we leverage regression priors to guide both the denoising process and latent decoding of the LDM, suppressing hallucinations while preserving structural accuracy. Extensive experiments demonstrate that GMODiff performs favorably against several state-of-the-art methods and is 100x faster than previous LDM-based methods. Code is available at https://github.com/gbymat/GMODiff.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。