针对多相机驾驶场景重建难题,提出高效可靠的新框架
MRASfM: Multi-Camera Reconstruction and Aggregation through Structure-from-Motion in Driving Scenes
- 利用多相机固定空间关系提升位姿估计可靠性
- 用平面模型剔除路面误检点,提升重建质量
- 支持多场景聚合,适合自动驾驶环境建模
结构光流(SfM)可估计相机位姿并重建点云,是诸多任务的基础。然而,应用于多相机系统采集的驾驶场景时,面临位姿估计不可靠、路面重建异常点多、效率低等挑战。为此,我们提出专为驾驶场景设计的多相机重建与聚合结构光流(MRASfM)框架。通过在注册过程中利用多相机间的固定空间关系,增强位姿估计可靠性;采用平面模型有效去除三角化路面中的错误点,提升路面重建质量;将多相机组视为整体参与捆绑调整(BA),减少优化变量以提高效率。此外,MRASfM通过粗到细的场景关联与组装模块实现多场景聚合。我们在真实车辆上部署多相机系统,验证了该框架在多种场景下的泛化能力及复杂条件下的鲁棒性。大规模公共数据集验证显示,MRASfM在nuScenes数据集上达到0.124的绝对位姿误差,性能处于业界领先水平。
原文摘要 · Abstract (English)
Structure from Motion (SfM) estimates camera poses and reconstructs point clouds, forming a foundation for various tasks. However, applying SfM to driving scenes captured by multi-camera systems presents significant difficulties, including unreliable pose estimation, excessive outliers in road surface reconstruction, and low reconstruction efficiency. To address these limitations, we propose a Multi-camera Reconstruction and Aggregation Structure-from-Motion (MRASfM) framework specifically designed for driving scenes. MRASfM enhances the reliability of camera pose estimation by leveraging the fixed spatial relationships within the multi-camera system during the registration process. To improve the quality of road surface reconstruction, our framework employs a plane model to effectively remove erroneous points from the triangulated road surface. Moreover, treating the multi-camera set as a single unit in Bundle Adjustment (BA) helps reduce optimization variables to boost efficiency. In addition, MRASfM achieves multi-scene aggregation through scene association and assembly modules in a coarse-to-fine fashion. We deployed multi-camera systems on actual vehicles to validate the generalizability of MRASfM across various scenes and its robustness in challenging conditions through real-world applications. Furthermore, large-scale validation results on public datasets show the state-of-the-art performance of MRASfM, achieving 0.124 absolute pose error on the nuScenes dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。