突破传统曝光融合极限,实现9档差异的超动态范围成像。
UltraFusion: Ultra High Dynamic Imaging using Exposure Fusion
- 将曝光融合建模为引导修复问题,用欠曝图软引导补全过曝区域。
- 可处理最大9档曝光差异,显著优于现有方法在真实场景下的表现。
- 适合需要极端动态范围成像的应用,如风光摄影、车载视觉。
捕捉高动态范围(HDR)场景是相机设计中的核心挑战。主流方法采用多曝光融合,通过合并不同曝光值的图像来提升动态范围,但通常仅能处理3-4档的曝光差异。当面对需大跨度曝光差的超动态范围场景时,该方法常因对齐错误、光照不一致或色调映射伪影而失效。本文提出 model,首个可融合高达9档曝光差异输入的曝光融合技术。核心思想是将曝光融合视为一个引导修复问题:以欠曝图为引导,修复过曝区域中丢失的亮部细节。通过使用欠曝图作为软引导而非硬约束,模型对对齐误差和光照变化具有更强鲁棒性。同时,借助生成模型的图像先验,即使在极高的动态范围下也能生成自然的色调映射结果。在最新HDR基准测试中,本方法超越HDR-Transformer。为进一步验证性能,我们构建了新的真实世界数据集UltraFusion,涵盖最高达9档曝光差异的场景。实验表明,UltraFusion在多种复杂场景下均能生成高质量且美观的融合结果。代码与数据将公开于 https://openimaginglab.github.io/UltraFusion。
原文摘要 · Abstract (English)
Capturing high dynamic range (HDR) scenes is one of the most important issues in camera design. Majority of cameras use exposure fusion, which fuses images captured by different exposure levels, to increase dynamic range. However, this approach can only handle images with limited exposure difference, normally 3-4 stops. When applying to very high dynamic range scenes where a large exposure difference is required, this approach often fails due to incorrect alignment or inconsistent lighting between inputs, or tone mapping artifacts. In this work, we propose \model, the first exposure fusion technique that can merge inputs with 9 stops differences. The key idea is that we model exposure fusion as a guided inpainting problem, where the under-exposed image is used as a guidance to fill the missing information of over-exposed highlights in the over-exposed region. Using an under-exposed image as a soft guidance, instead of a hard constraint, our model is robust to potential alignment issue or lighting variations. Moreover, by utilizing the image prior of the generative model, our model also generates natural tone mapping, even for very high-dynamic range scenes. Our approach outperforms HDR-Transformer on latest HDR benchmarks. Moreover, to test its performance in ultra high dynamic range scenes, we capture a new real-world exposure fusion benchmark, UltraFusion dataset, with exposure differences up to 9 stops, and experiments show that UltraFusion can generate beautiful and high-quality fusion results under various scenarios. Code and data will be available at https://openimaginglab.github.io/UltraFusion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。