arXiv:2409.19811cs.CV2024-09ECCV被引 35

融合点与线特征,提升弱纹理场景下的三维重建精度。

Robust Incremental Structure-from-Motion with Hybrid Features

  • 结合关键点与线段,利用其几何结构增强约束
  • 在挑战性场景中显著降低误差,提升重建鲁棒性
  • 支持不确定性传播,适合高精度定位应用

结构光重建(SfM)已成为计算机视觉中相机标定与场景重建的通用工具。尽管当前最先进的SfM流水线在纹理丰富、配置良好的场景中已趋于成熟,但在弱纹理或欠约束条件下仍易失效。此时线段通常更丰富,能提供比传统关键点更强的几何约束。本文提出一种增量式SfM系统,同时利用点和线及其结构化几何关系,覆盖映射、三角化、配准等全流程,并公开了开源实现。我们首次提出基于敏感性分析的3D线段不确定性传播方法。实验表明,该系统在挑战性场景下相比主流点基SfM方法更具鲁棒性和准确性,生成更丰富的地图和更精确的相机位姿;其不确定性感知定位模块在纯点与混合设置下均持续优于现有方法。

原文摘要 · Abstract (English)

Structure-from-Motion (SfM) has become a ubiquitous tool for camera calibration and scene reconstruction with many downstream applications in computer vision and beyond. While the state-of-the-art SfM pipelines have reached a high level of maturity in well-textured and well-configured scenes over the last decades, they still fall short of robustly solving the SfM problem in challenging scenarios. In particular, weakly textured scenes and poorly constrained configurations oftentimes cause catastrophic failures or large errors for the primarily keypoint-based pipelines. In these scenarios, line segments are often abundant and can offer complementary geometric constraints. Their large spatial extent and typically structured configurations lead to stronger geometric constraints as compared to traditional keypoint-based methods. In this work, we introduce an incremental SfM system that, in addition to points, leverages lines and their structured geometric relations. Our technical contributions span the entire pipeline (mapping, triangulation, registration) and we integrate these into a comprehensive end-to-end SfM system that we share as an open-source software with the community. We also present the first analytical method to propagate uncertainties for 3D optimized lines via sensitivity analysis. Experiments show that our system is consistently more robust and accurate compared to the widely used point-based state of the art in SfM -- achieving richer maps and more precise camera registrations, especially under challenging conditions. In addition, our uncertainty-aware localization module alone is able to consistently improve over the state of the art under both point-alone and hybrid setups.

三维重建SfM线特征鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。