arXiv:2504.09379cs.CV2025-04ICCV被引 18

用事件相机时间映射信号估计光照,提升暗光图像增强效果。

Low-Light Image Enhancement using Event-Based Illumination Estimation

  • 通过时间映射事件将时间戳转为亮度值,实现精细光照估计
  • 在5个合成数据集和真实数据集上提升至6.62 dB,推理速度达35.6帧/秒
  • 适合需要高动态范围与低光响应的视觉系统开发者

低光图像增强(LLIE)旨在提升弱光环境下拍摄图像的可视性。现有基于事件的方法主要依赖运动事件来增强边缘纹理,而未充分利用事件相机的高动态范围与优异低光响应特性。本文从光照估计角度出发,提出利用‘时间映射事件’——即通过调制透光率触发的事件时间戳转换为亮度值——获取精细光照线索。该线索支持提出的光照辅助反射分量增强模块,实现更有效的图像分解与增强。同时,研究了低光条件下时间映射事件的退化模型,用于生成真实训练数据。针对该场景缺乏数据集的问题,构建分束器装置,采集包含图像、时间映射事件与运动事件的EvLowLight数据集。在5个合成数据集及真实数据集上的实验证明,所提方法RetinEV可生成高动态范围、良好光照的图像,在性能上超越现有最优事件基方法最高达6.62 dB,且在640×480图像上保持35.6帧/秒的高效推理速度。

原文摘要 · Abstract (English)

Low-light image enhancement (LLIE) aims to improve the visibility of images captured in poorly lit environments. Prevalent event-based solutions primarily utilize events triggered by motion, i.e., ''motion events'' to strengthen only the edge texture, while leaving the high dynamic range and excellent low-light responsiveness of event cameras largely unexplored. This paper instead opens a new avenue from the perspective of estimating the illumination using ''temporal-mapping'' events, i.e., by converting the timestamps of events triggered by a transmittance modulation into brightness values. The resulting fine-grained illumination cues facilitate a more effective decomposition and enhancement of the reflectance component in low-light images through the proposed Illumination-aided Reflectance Enhancement module. Furthermore, the degradation model of temporal-mapping events under low-light condition is investigated for realistic training data synthesizing. To address the lack of datasets under this regime, we construct a beam-splitter setup and collect EvLowLight dataset that includes images, temporal-mapping events, and motion events. Extensive experiments across 5 synthetic datasets and our real-world EvLowLight dataset substantiate that the devised pipeline, dubbed RetinEV, excels in producing well-illuminated, high dynamic range images, outperforming previous state-of-the-art event-based methods by up to 6.62 dB, while maintaining an efficient inference speed of 35.6 frame-per-second on a 640X480 image.

低光增强事件相机光照估计图像增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。