arXiv:2504.08588cs.CV2025-04综述被引 25

综述类神经形态视觉传感器的硬件、算法与应用前景。

Hardware, Algorithms, and Applications of the Neuromorphic Vision Sensor: a Review

  • 从硬件到算法系统梳理事件相机技术演进
  • 覆盖特征检测、跟踪、深度估计等核心算法
  • 适合关注新型视觉传感与智能感知的科研人员

神经形态(事件)相机改变了传统视觉传感方式,将像素级光照变化异步编码为事件数据流。相较于标准相机在固定时间间隔捕获完整图像帧,其稀疏数据格式具有低延迟、高动态范围等优势,适用于多种场景。但这也要求重新设计或适配算法以处理该新数据形式。本文从三个维度系统综述神经形态视觉:首先,梳理从早期到最新模型的硬件发展与特性;其次,回顾专为事件数据设计的图像处理算法,涵盖特征检测、目标跟踪、光流计算等基础任务,以及深度估计、姿态估计与物体识别等复杂场景理解任务;这些方法融合经典计算机视觉与现代数据驱动方法,展示事件相机的应用广度。第三,通过多个行业实际案例说明其成功应用。最后,分析当前推广瓶颈,指出与传统成像技术相比的研究空白,并展望未来发展方向与机遇。

原文摘要 · Abstract (English)

Neuromorphic, or event, cameras represent a transformation in the classical approach to visual sensing encodes detected instantaneous per-pixel illumination changes into an asynchronous stream of event packets. Their novelty compared to standard cameras lies in the transition from capturing full picture frames at fixed time intervals to a sparse data format which, with its distinctive qualities, offers potential improvements in various applications. However, these advantages come at the cost of reinventing algorithmic procedures or adapting them to effectively process the new data format. In this survey, we systematically examine neuromorphic vision along three main dimensions. First, we highlight the technological evolution and distinctive hardware features of neuromorphic cameras from their inception to recent models. Second, we review image processing algorithms developed explicitly for event-based data, covering key works on feature detection, tracking, and optical flow -which form the basis for analyzing image elements and transformations -as well as depth and pose estimation or object recognition, which interpret more complex scene structures and components. These techniques, drawn from classical computer vision and modern data-driven approaches, are examined to illustrate the breadth of applications for event-based cameras. Third, we present practical application case studies demonstrating how event cameras have been successfully used across various industries and scenarios. Finally, we analyze the challenges limiting widespread adoption, identify significant research gaps compared to standard imaging techniques, and outline promising future directions and opportunities that neuromorphic vision offers.

神经形态视觉事件相机计算机视觉传感技术

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。