用几何约束解决多视角特征匹配难题,提升3D重建鲁棒性。
C-DOG: Multi-View Multi-instance Feature Association Using Connected δ-Overlap Graphs
- 基于视差几何和δ重叠图构建特征关联,避免外观相似导致的混淆。
- 在高密度、低纹理、相机重叠少场景下仍保持高精度,误匹配率低于5%。
- 适合需要高鲁棒性的实际3D重建系统,如自动驾驶与机器人导航。
多视角多实例特征关联是3D重建中的关键步骤,有助于在不同摄像机视角间一致地分组物体实例。场景中存在多个相同物体时,基于外观的特征匹配算法易产生歧义。本文通过仅使用几何约束(特别是极线几何)来规避此问题。提出C-DOG(Connected δ-Overlap Graph)算法,用于在存在噪声特征检测的情况下实现鲁棒的几何特征关联。在C-DOG图中,来自不同视图的两个2D特征点若对应同一3D点,则通过边连接,边权重为对应的极线距离。理想情况下,真实关联的极线距离为0,但噪声检测会导致非零值。为稳健保留极线距离小于阈值δ的边,采用Szymkiewicz-Simpson系数进行δ邻域重叠聚类,并利用四分位距(IQR)准则剔除不可靠节点。大量合成基准测试表明,C-DOG不仅优于基于几何的基线算法,且在高物体密度、缺乏视觉特征、相机重叠受限等严苛条件下仍表现出显著鲁棒性,适用于实际应用中的可扩展3D重建。
原文摘要 · Abstract (English)
Multi-view multi-instance feature association constitutes a crucial step in 3D reconstruction, facilitating the consistent grouping of object instances across various camera perspectives. The presence of multiple identical objects within a scene often leads to ambiguities for appearance-based feature matching algorithms. Our work circumvents this challenge by exclusively employing geometrical constraints, specifically epipolar geometry, for feature association. We introduce C-DOG (Connected delta-Overlap Graph), an algorithm designed for robust geometrical feature association, even in the presence of noisy feature detections. In a C-DOG graph, two nodes representing 2D feature points from distinct views are connected by an edge if they correspond to the same 3D point. Each edge is weighted by its epipolar distance. Ideally, true associations yield a zero distance; however, noisy feature detections can result in non-zero values. To robustly retain edges where the epipolar distance is less than a threshold delta, we employ a Szymkiewicz--Simpson coefficient. This process leads to a delta-neighbor-overlap clustering of 2D nodes. Furthermore, unreliable nodes are pruned from these clusters using an Inter-quartile Range (IQR)-based criterion. Our extensive experiments on synthetic benchmarks demonstrate that C-DOG not only outperforms geometry-based baseline algorithms but also remains remarkably robust under demanding conditions. This includes scenes with high object density, no visual features, and restricted camera overlap, positioning C-DOG as an excellent solution for scalable 3D reconstruction in practical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。