arXiv:2412.14705cs.CV2024-12被引 4

用事件相机辅助,实现动态场景下12档高动态范围成像

Event-assisted 12-stop HDR Imaging of Dynamic Scene

  • 双相机系统融合事件信号与RGB图像,提升极端曝光差异下的对齐精度
  • 在动态场景中实现12档HDR成像,显著减少运动伪影
  • 适合需要高动态范围视频采集的科研与工业应用

高动态范围(HDR)成像是计算摄影中的关键任务,旨在捕捉复杂光照条件下的细节。传统HDR融合方法在动态场景中受限于大曝光差异导致的低动态范围(LDR)帧对齐困难,易产生运动伪影。本文提出一种基于事件相机与RGB相机双摄系统的12档HDR成像新方法。事件相机提供时间密集、高动态范围的信号,显著改善大曝光差异下LDR帧的对齐效果,降低运动引起的鬼影。同时,设计真实场景微调策略以增强对齐模块在真实事件数据上的泛化能力。进一步引入基于扩散模型的融合模块,利用预训练扩散模型的图像先验,缓解高对比区域的伪影并减少对齐误差。为支持该工作,构建了首个同步事件信号的12档HDR数据集ESHDR。在模拟与真实数据上验证表明,本方法达到当前最优性能,成功将动态场景下的HDR成像扩展至12档。

原文摘要 · Abstract (English)

High dynamic range (HDR) imaging is a crucial task in computational photography, which captures details across diverse lighting conditions. Traditional HDR fusion methods face limitations in dynamic scenes with extreme exposure differences, as aligning low dynamic range (LDR) frames becomes challenging due to motion and brightness variation. In this work, we propose a novel 12-stop HDR imaging approach for dynamic scenes, leveraging a dual-camera system with an event camera and an RGB camera. The event camera provides temporally dense, high dynamic range signals that improve alignment between LDR frames with large exposure differences, reducing ghosting artifacts caused by motion. Also, a real-world finetuning strategy is proposed to increase the generalization of alignment module on real-world events. Additionally, we introduce a diffusion-based fusion module that incorporates image priors from pre-trained diffusion models to address artifacts in high-contrast regions and minimize errors from the alignment process. To support this work, we developed the ESHDR dataset, the first dataset for 12-stop HDR imaging with synchronized event signals, and validated our approach on both simulated and real-world data. Extensive experiments demonstrate that our method achieves state-of-the-art performance, successfully extending HDR imaging to 12 stops in dynamic scenes.

HDR成像事件相机动态场景扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。