arXiv:2507.06593cs.CVeess.IV2025-07被引 2

用双相机系统解决HDR视频闪烁问题,效果更稳。

Capturing Stable HDR Videos Using a Dual-Camera System

  • 双相机异步曝光,无需同步,避免闪烁
  • 新网络融合不同曝光图像,减少鬼影保留细节
  • 适合需要高质量HDR视频的拍摄与后期制作

使用交替曝光(AE)范式的高动态范围(HDR)视频采集因单台消费级相机成本低而受到广泛关注。然而,尽管深度神经网络取得了进展,这些方法在真实场景中仍易受帧间曝光不一致影响,导致时间闪烁。为在保持AE范式低成本优势的同时解决此问题,我们提出一种基于学习的新型HDR视频生成方案。具体而言,提出双流HDR视频生成范式,将时间亮度锚定与曝光变化的细节重建解耦,克服了AE范式的固有局限。为此,设计了一种异步双相机系统(DCS),支持两台相机独立控制曝光,无需传统多相机系统所需的同步。此外,构建了针对DCS的曝光自适应融合网络(EAFNet),包含预对齐子网络实现跨曝光特征对齐,非对称交叉特征融合子网络强调参考基注意力以有效融合特征,以及重建子网络减轻鬼影并保留细粒度细节。大量实验表明,所提方法在多个数据集上均达到当前最优性能,展现出该方案在HDR视频重建中的显著潜力。代码与DCS采集数据将在https://zqqqyu.github.io/DCS-HDR/公开。

原文摘要 · Abstract (English)

High Dynamic Range (HDR) video acquisition using the alternating exposure (AE) paradigm has garnered significant attention due to its cost-effectiveness with a single consumer camera. However, despite progress driven by deep neural networks, these methods remain prone to temporal flicker in real-world applications due to inter-frame exposure inconsistencies. To address this challenge while maintaining the cost-effectiveness of the AE paradigm, we propose a novel learning-based HDR video generation solution. Specifically, we propose a dual-stream HDR video generation paradigm that decouples temporal luminance anchoring from exposure-variant detail reconstruction, overcoming the inherent limitations of the AE paradigm. To support this, we design an asynchronous dual-camera system (DCS), which enables independent exposure control across two cameras, eliminating the need for synchronization typically required in traditional multi-camera setups. Furthermore, an exposure-adaptive fusion network (EAFNet) is formulated for the DCS system. EAFNet integrates a pre-alignment subnetwork that aligns features across varying exposures, ensuring robust feature extraction for subsequent fusion, an asymmetric cross-feature fusion subnetwork that emphasizes reference-based attention to effectively merge these features across exposures, and a reconstruction subnetwork to mitigate ghosting artifacts and preserve fine details. Extensive experimental evaluations demonstrate that the proposed method achieves state-of-the-art performance across various datasets, showing the remarkable potential of our solution in HDR video reconstruction. The codes and data captured by DCS will be available at https://zqqqyu.github.io/DCS-HDR/.

HDR视频双相机去闪烁图像融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。