arXiv:2409.01764cs.CV2024-09被引 1

提出梯度事件,让事件相机更抗闪烁光,重建图像更清晰

Gradient events: improved acquisition of visual information in event cameras

  • 用梯度变化替代亮度变化生成事件信号
  • 在有闪烁光源时减少无效事件,提升帧重建质量
  • 适合需要高动态、抗干扰视觉感知的场景

当前事件相机是仿生传感器,异步响应像素亮度变化,并将变化以三值事件流形式输出。相比传统数字相机,事件相机具有更高的时间分辨率和像素带宽,显著降低运动模糊,并具备极高的动态范围。但其也带来挑战:现有计算机视觉算法难以直接处理事件流,且在闪烁光源下会产生大量无意义事件。本文提出一种新型事件——梯度事件,兼具传统亮度事件的优势,但设计上对闪烁光源不敏感,可显著改善灰度帧重建效果。在公开的事件到视频数据集上评估显示,基于梯度事件的视频重建性能远超现有最先进的亮度事件方法。

原文摘要 · Abstract (English)

The current event cameras are bio-inspired sensors that respond to brightness changes in the scene asynchronously and independently for every pixel, and transmit these changes as ternary event streams. Event cameras have several benefits over conventional digital cameras, such as significantly higher temporal resolution and pixel bandwidth resulting in reduced motion blur, and very high dynamic range. However, they also introduce challenges such as the difficulty of applying existing computer vision algorithms to the output event streams, and the flood of uninformative events in the presence of oscillating light sources. Here we propose a new type of event, the gradient event, which benefits from the same properties as a conventional brightness event, but which is by design much less sensitive to oscillating light sources, and which enables considerably better grayscale frame reconstruction. We show that the gradient event -based video reconstruction outperforms existing state-of-the-art brightness event -based methods by a significant margin, when evaluated on publicly available event-to-video datasets. Our results show how gradient information can be used to significantly improve the acquisition of visual information by an event camera.

事件相机梯度事件图像重建抗闪烁

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。