对比传统相机,神经形态相机在高速模糊和低光下更优,这篇综述系统评估了相关检测算法。
Neuromorphic Object Detection: An In-Depth Study and Future Directions

- 梳理神经形态视觉流的事件表示与异步处理机制
- 在多个数据集上评估主流模型性能,揭示关键瓶颈
- 适合关注低延迟、低功耗视觉系统的研究者
传统帧式摄像头在高速运动模糊或低光照环境下难以有效检测物体。神经形态摄像头通过提供高时间分辨率和宽动态范围的异步视觉流,为复杂条件下的目标检测提供了新方案。尽管已有众多模型和应用出现,但对技术进展的理解仍不深入,缺乏标准化基准。本文全面调研并评测现有神经形态目标检测算法:首先描述问题,回顾可用数据集与评估指标;接着从事件表示、时序建模、多模态融合、异步处理、低延迟计算及能效优化等角度分析现有方法;随后在广泛代表性模型上进行评测,给出详细结果对比;最后讨论未解难题,提出未来研究方向。希望本综述与基准能为研究人员提供宝贵资源,指引领域发展。
原文摘要 · Abstract (English)
Conventional frame-based cameras face significant challenges in detecting objects under high-speed motion blur or in low-light environments. Neuromorphic cameras provide asynchronous visual streams with high temporal resolution and a wide dynamic range, offering a promising solution for object detection under challenging conditions. Despite the development of numerous models and the emergence of various applications in neuromorphic object detection, there is still a lack of deep understanding and standardized benchmarks to assess progress and address key challenges. In this paper, we provide a comprehensive survey and benchmark of existing neuromorphic object detection algorithms. Specifically, we first present a problem description, review the available datasets, and revisit the evaluation metrics. We then explore existing neuromorphic object detection approaches from various perspectives, including event representation, temporal modeling, multimodal fusion, asynchronous processing, low-latency processing, and energy-efficient computing. Furthermore, we evaluate a wide range of representative neuromorphic object detection models and offer detailed analyses of the comparative results. Finally, we discuss unresolved issues in neuromorphic object detection and propose potential future research directions. We hope this survey and benchmark will be a valuable resource for researchers and provide guidance for future advancements in neuromorphic object detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。