首篇综述事件相机3D重建,系统梳理技术路线与挑战
A Survey of 3D Reconstruction with Event Cameras
- 按输入模态分立体、单目、多模态,按方法分几何、深度学习、神经渲染
- 涵盖NeRF、3DGS等主流方法,梳理从早期到最新的技术演进
- 适合关注事件相机、3D重建的科研人员和工程师参考
事件相机作为新兴视觉传感器,在3D重建中展现出强大潜力,能异步捕捉像素级亮度变化。相比传统帧式相机,事件相机生成稀疏但时间密度高的数据流,可在高速运动、低光照和极端动态范围等严苛条件下实现鲁棒、精准的3D重建,为自动驾驶、机器人、空中导航及沉浸式虚拟现实等领域带来变革性应用前景。本文首次系统综述事件相机驱动的3D重建技术,按输入模态分为立体、单目和多模态系统,并根据重建方法细分为基于几何、深度学习以及神经渲染(如NeRF和3DGS)三类。各方法按时间顺序排列,展现关键技术演进。同时整理了专用于事件重建的公开数据集。最后讨论数据集稀缺、评估标准不统一、有效表征困难及动态场景重建等关键挑战,提出未来研究方向。本综述旨在为该领域提供权威参考与清晰发展路径。
原文摘要 · Abstract (English)
Event cameras are rapidly emerging as powerful vision sensors for 3D reconstruction, uniquely capable of asynchronously capturing per-pixel brightness changes. Compared to traditional frame-based cameras, event cameras produce sparse yet temporally dense data streams, enabling robust and accurate 3D reconstruction even under challenging conditions such as high-speed motion, low illumination, and extreme dynamic range scenarios. These capabilities offer substantial promise for transformative applications across various fields, including autonomous driving, robotics, aerial navigation, and immersive virtual reality. In this survey, we present the first comprehensive review exclusively dedicated to event-based 3D reconstruction. Existing approaches are systematically categorised based on input modality into stereo, monocular, and multimodal systems, and further classified according to reconstruction methodologies, including geometry-based techniques, deep learning approaches, and neural rendering techniques such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS). Within each category, methods are chronologically organised to highlight the evolution of key concepts and advancements. Furthermore, we provide a detailed summary of publicly available datasets specifically suited to event-based reconstruction tasks. Finally, we discuss significant open challenges in dataset availability, standardised evaluation, effective representation, and dynamic scene reconstruction, outlining insightful directions for future research. This survey aims to serve as an essential reference and provides a clear and motivating roadmap toward advancing the state of the art in event-driven 3D reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。