arXiv:2601.02206cs.CVcs.AI2026-01AAAI被引 4

用事件相机提升暗光视频画质,细节更清晰、速度更快。

Seeing the Unseen: Zooming in the Dark with Event Cameras

  • 结合事件信号与视觉先验,双向融合多模态信息增强画质。
  • 在SDSD数据集上提升2.95 dB,推理速度比之前快65%。
  • 适合做暗光视频增强的科研与工业应用。

本文针对低光照视频超分辨率(LVSR)问题,旨在从低光照、低分辨率输入中恢复高分辨率视频。现有方法因对比度不足和高频信息缺失,难以还原细节。为此,我们提出首个基于事件相机的LVSR框架RetinexEVSR,利用高对比度事件信号与受Retinex启发的先验知识,在低光照条件下提升视频质量。不同于直接融合退化信号的旧方法,RetinexEVSR设计了一种新型双向跨模态融合策略,从噪声事件数据与退化RGB帧中提取并整合有效线索。具体地,提出光照引导的事件增强模块,通过Retinex模型生成的光照图逐步优化事件特征,抑制暗光伪影并保留高对比度细节;同时设计事件引导的反射率增强模块,利用增强事件特征通过多尺度融合机制动态恢复反射率细节。实验表明,该方法在三个数据集上达到当前最佳性能。尤其在SDSD基准上,相比先前事件基方法,性能提升最高达2.95 dB,且运行时间减少65%。代码已开源:https://github.com/DachunKai/RetinexEVSR。

原文摘要 · Abstract (English)

This paper addresses low-light video super-resolution (LVSR), aiming to restore high-resolution videos from low-light, low-resolution (LR) inputs. Existing LVSR methods often struggle to recover fine details due to limited contrast and insufficient high-frequency information. To overcome these challenges, we present RetinexEVSR, the first event-driven LVSR framework that leverages high-contrast event signals and Retinex-inspired priors to enhance video quality under low-light scenarios. Unlike previous approaches that directly fuse degraded signals, RetinexEVSR introduces a novel bidirectional cross-modal fusion strategy to extract and integrate meaningful cues from noisy event data and degraded RGB frames. Specifically, an illumination-guided event enhancement module is designed to progressively refine event features using illumination maps derived from the Retinex model, thereby suppressing low-light artifacts while preserving high-contrast details. Furthermore, we propose an event-guided reflectance enhancement module that utilizes the enhanced event features to dynamically recover reflectance details via a multi-scale fusion mechanism. Experimental results show that our RetinexEVSR achieves state-of-the-art performance on three datasets. Notably, on the SDSD benchmark, our method can get up to 2.95 dB gain while reducing runtime by 65% compared to prior event-based methods. Code: https://github.com/DachunKai/RetinexEVSR.

视频超分事件相机暗光增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。