arXiv:2409.17680cs.CVcs.RO2024-09TPAMI综述被引 39

综述事件相机立体深度估计技术,涵盖方法、数据集与未来方向。

Event-based Stereo Depth Estimation: A Survey

  • 系统梳理事件相机立体匹配的瞬时与长期方法
  • 首次全面评述深度学习方法及常用立体数据集
  • 适合初学者入门与资深研究者参考,提供建基准建议

立体视觉在机器人领域广受欢迎,是生物感知三维空间的主要方式。事件相机是一种类生物的新型传感器,能异步检测像素亮度变化,具备极高的时间分辨率和动态范围,适用于高速运动与宽光照条件下的机器感知。其高时间精度也促进了立体匹配的发展,使深度估计成为事件相机的重要研究方向。过去三十年间,该领域从低延迟低功耗电路设计发展到当前由计算机视觉社区主导的深度学习方法。由于跨学科性强,文献庞杂,非专业人士难以导航。以往综述多聚焦特定应用或技术类别,且忽略立体数据集。本文首次全面回顾了瞬时与长期立体方法(适用于同时定位与地图构建),并进行理论与实证对比。首次系统评述深度学习方法与立体数据集,并提出创建新基准的实用建议。讨论了事件相机立体深度估计的主要优势与挑战。尽管进展显著,但在精度与效率方面仍面临瓶颈,而效率是事件计算的核心。本文识别若干空白,提出未来研究方向,旨在为新人提供入门路径,为资深研究者提供实践指南。

原文摘要 · Abstract (English)

Stereopsis has widespread appeal in robotics as it is the predominant way by which living beings perceive depth to navigate our 3D world. Event cameras are novel bio-inspired sensors that detect per-pixel brightness changes asynchronously, with very high temporal resolution and high dynamic range, enabling machine perception in high-speed motion and broad illumination conditions. The high temporal precision also benefits stereo matching, making disparity (depth) estimation a popular research area for event cameras ever since its inception. Over the last 30 years, the field has evolved rapidly, from low-latency, low-power circuit design to current deep learning (DL) approaches driven by the computer vision community. The bibliography is vast and difficult to navigate for non-experts due its highly interdisciplinary nature. Past surveys have addressed distinct aspects of this topic, in the context of applications, or focusing only on a specific class of techniques, but have overlooked stereo datasets. This survey provides a comprehensive overview, covering both instantaneous stereo and long-term methods suitable for simultaneous localization and mapping (SLAM), along with theoretical and empirical comparisons. It is the first to extensively review DL methods as well as stereo datasets, even providing practical suggestions for creating new benchmarks to advance the field. The main advantages and challenges faced by event-based stereo depth estimation are also discussed. Despite significant progress, challenges remain in achieving optimal performance in not only accuracy but also efficiency, a cornerstone of event-based computing. We identify several gaps and propose future research directions. We hope this survey inspires future research in this area, by serving as an accessible entry point for newcomers, as well as a practical guide for seasoned researchers in the community.

事件相机立体深度综述SLAM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。