用事件相机+视网膜理论,提升暗光图像清晰度
ERetinex: Event Camera Meets Retinex Theory for Low-Light Image Enhancement
- 结合事件相机高时序数据与视网膜理论估算光照
- 比现有方法提升1.0613 dB PSNR,计算量降低84.28%
- 适合夜间视觉、低光机器人等极端照明场景
暗光图像增强旨在恢复黑暗环境下曝光不足的图像。传统帧式相机因曝光时间限制,在暗光条件下难以捕捉结构与色彩信息。事件相机是仿生视觉传感器,能异步响应像素亮度变化,具备高动态范围,适用于极端暗光场景,优于传统相机。本文受视网膜理论在传统图像增强中成功启发,首次将视网膜理论与事件相机结合,提出名为ERetinex的新框架。首先,提出一种新方法,利用事件相机的高时间分辨率数据与传统图像信息联合估计场景光照,显著优于仅依赖图像的方法,尤其在暗光环境中提供更精确的光照信息。其次,设计了一种有效融合策略,将事件相机的高动态范围数据与传统图像的颜色信息融合,生成更清晰、细节更丰富的图像,在极端光照下仍保持视觉信息完整性。实验表明,所提方法超越当前最优(SOTA)方法,PSNR提升1.0613 dB,同时减少84.28%的浮点运算量(FLOPS)。
原文摘要 · Abstract (English)
Low-light image enhancement aims to restore the under-exposure image captured in dark scenarios. Under such scenarios, traditional frame-based cameras may fail to capture the structure and color information due to the exposure time limitation. Event cameras are bio-inspired vision sensors that respond to pixel-wise brightness changes asynchronously. Event cameras' high dynamic range is pivotal for visual perception in extreme low-light scenarios, surpassing traditional cameras and enabling applications in challenging dark environments. In this paper, inspired by the success of the retinex theory for traditional frame-based low-light image restoration, we introduce the first methods that combine the retinex theory with event cameras and propose a novel retinex-based low-light image restoration framework named ERetinex. Among our contributions, the first is developing a new approach that leverages the high temporal resolution data from event cameras with traditional image information to estimate scene illumination accurately. This method outperforms traditional image-only techniques, especially in low-light environments, by providing more precise lighting information. Additionally, we propose an effective fusion strategy that combines the high dynamic range data from event cameras with the color information of traditional images to enhance image quality. Through this fusion, we can generate clearer and more detail-rich images, maintaining the integrity of visual information even under extreme lighting conditions. The experimental results indicate that our proposed method outperforms state-of-the-art (SOTA) methods, achieving a gain of 1.0613 dB in PSNR while reducing FLOPS by \textbf{84.28}\%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。