arXiv:2603.00467cs.CV2026-03中稿 · Optics Express被引 1

用异构双模相机实现极端光照下的高动态范围成像

High Dynamic Range Imaging Based on an Asymmetric Event-SVE Camera System

  • 将SVE微衰减相机与事件传感器异构集成,提升动态范围
  • 跨模态对齐与融合网络显著改善高光恢复和边缘保真度
  • 适合需要强光照适应能力的自动驾驶与机器人视觉

在极端光照条件下,传统相机易因过曝导致高动态范围(HDR)成像困难。事件相机具备微秒级时间分辨率和高动态范围,而空间可变曝光(SVE)传感器则提供单次拍摄的辐射多样性。本文提出一种软硬件协同设计的HDR成像系统,将SVE微衰减相机与事件传感器以非共轴异构双模结构紧密集成。为应对非共轴几何与异质光学问题,开发了两阶段跨模态对齐框架,结合特征引导粗略单应性估计与基于空间池化和频域滤波的多尺度精修模块。在此基础上,构建跨模态HDR重建网络,包含卷积融合、互信息正则化及可学习融合损失,自适应平衡强度线索与事件衍生的结构约束。在合成基准与真实采集数据上的综合实验表明,所提系统在高光恢复、边缘保真度和鲁棒性方面均优于仅帧或仅事件的HDR方案。结果表明,联合优化光学设计、跨模态对齐与计算融合,为复杂辐射环境下可靠HDR感知提供了有效基础。

原文摘要 · Abstract (English)

High dynamic range (HDR) imaging under extreme illumination remains challenging for conventional cameras due to overexposure. Event cameras provide microsecond temporal resolution and high dynamic range, while spatially varying exposure (SVE) sensors offer single-shot radiometric diversity.We present a hardware--algorithm co-designed HDR imaging system that tightly integrates an SVE micro-attenuation camera with an event sensor in an asymmetric dual-modality configuration. To handle non-coaxial geometry and heterogeneous optics, we develop a two-stage cross-modal alignment framework that combines feature-guided coarse homography estimation with a multi-scale refinement module based on spatial pooling and frequency-domain filtering. On top of aligned representations, we develop a cross-modal HDR reconstruction network with convolutional fusion, mutual-information regularization, and a learnable fusion loss that adaptively balances intensity cues and event-derived structural constraints. Comprehensive experiments on both synthetic benchmarks and real captures demonstrate that the proposed system consistently improves highlight recovery, edge fidelity, and robustness compared with frame-only or event-only HDR pipelines. The results indicate that jointly optimizing optical design, cross-modal alignment, and computational fusion provides an effective foundation for reliable HDR perception in highly dynamic and radiometrically challenging environments.

HDR成像事件相机跨模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。