arXiv:2604.06161cs.CVcs.AI2026-04中稿 · ECCV被引 2

用视频扩散模型还原低动态范围视频的高光与暗部细节,实现可调控的高清重曝光。

DiffHDR: Re-Exposing LDR Videos with Video Diffusion Models

  • 在对数伽马空间中,利用预训练视频扩散模型的时空生成先验进行辐射率补全。
  • 相比现有方法,在辐射率保真度和时序稳定性上均有显著提升,支持灵活重曝光。
  • 适用于影视后期、真实场景重渲染,尤其适合缺乏成对数据的场景重建。

大多数数字视频以8位低动态范围(LDR)格式存储,因饱和与量化导致原始高动态范围(HDR)场景辐射信息大量丢失,使高光与暗部细节无法准确映射至HDR显示设备,并限制后期重曝光的可行性。尽管已有技术尝试通过动态范围扩展将LDR图像转为HDR,但在过曝与欠曝区域仍难以恢复真实细节。为此,我们提出DiffHDR框架,将LDR到HDR的转换建模为视频扩散模型潜在空间中的生成辐射率修补任务。通过在对数伽马颜色空间中操作,该方法利用预训练视频扩散模型的时空生成先验,在过曝与欠曝区域合成合理的HDR辐射值,同时恢复量化像素的连续场景辐射。该框架还可通过文本提示或参考图像实现可控转换。为缓解成对HDR视频数据稀缺问题,我们构建了从静态HDRI图合成高质量HDR视频数据的流水线。大量实验表明,DiffHDR在辐射率保真度与时序稳定性方面显著优于当前最优方法,生成的HDR视频具有显著的重曝光宽容度。

原文摘要 · Abstract (English)

Most digital videos are stored in 8-bit low dynamic range (LDR) formats, where much of the original high dynamic range (HDR) scene radiance is lost due to saturation and quantization. This loss of highlight and shadow detail precludes mapping accurate luminance to HDR displays and limits meaningful re-exposure in post-production workflows. Although techniques have been proposed to convert LDR images to HDR through dynamic range expansion, they struggle to restore realistic detail in the over- and underexposed regions. To address this, we present DiffHDR, a framework that formulates LDR-to-HDR conversion as a generative radiance inpainting task within the latent space of a video diffusion model. By operating in Log-Gamma color space, DiffHDR leverages spatio-temporal generative priors from a pretrained video diffusion model to synthesize plausible HDR radiance in over- and underexposed regions while recovering the continuous scene radiance of the quantized pixels. Our framework further enables controllable LDR-to-HDR video conversion guided by text prompts or reference images. To address the scarcity of paired HDR video data, we develop a pipeline that synthesizes high-quality HDR video training data from static HDRI maps. Extensive experiments demonstrate that DiffHDR significantly outperforms state-of-the-art approaches in radiance fidelity and temporal stability, producing realistic HDR videos with considerable latitude for re-exposure.

视频生成扩散模型HDR重建重曝光

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。