arXiv:2508.02278cs.CV2025-08ICCV被引 2

提出SGAD描述符,让局部特征匹配又快又准。

SGAD: Semantic and Geometric-aware Descriptor for Local Feature Matching

  • 用语义与几何感知生成强区分性区域描述符,直接匹配无需复杂优化。
  • 相比MESA提速60倍(0.82秒),在户外/室内场景显著提升精度。
  • 适合需要高效高精度匹配的三维重建与定位任务,尤其关注推理速度者。

局部特征匹配仍是计算机视觉中的基础挑战。近期基于区域到点匹配(A2PM)的方法提升了匹配精度,但现有研究依赖低效的像素级对比和复杂的图匹配,限制了可扩展性。本文提出语义与几何感知描述符网络(SGAD),从根本上重构区域匹配方式:生成高度区分性的区域描述符,实现无需复杂图优化的直接匹配,显著提升匹配的准确率与效率。通过将区域匹配任务分解为分类与排序子任务,设计新型监督策略进一步优化性能。此外,引入分层包含冗余过滤器(HCRF),通过分析包含图消除重叠区域。大量实验表明,SGAD性能大幅提升:相较MESA运行时间减少60倍(0.82秒 vs. 60.23秒)。在多个点匹配器上均实现一致改进:SGAD+LoFTR在室外位姿估计中速度更快(0.82秒 vs. 1.51秒),精度更高(65.98 vs. 61.11);SGAD+ROMA在室内位姿估计中提升7.39% AUC@5°,刷新当前最优结果。

原文摘要 · Abstract (English)

Local feature matching remains a fundamental challenge in computer vision. Recent Area to Point Matching (A2PM) methods have improved matching accuracy. However, existing research based on this framework relies on inefficient pixel-level comparisons and complex graph matching that limit scalability. In this work, we introduce the Semantic and Geometric-aware Descriptor Network (SGAD), which fundamentally rethinks area-based matching by generating highly discriminative area descriptors that enable direct matching without complex graph optimization. This approach significantly improves both accuracy and efficiency of area matching. We further improve the performance of area matching through a novel supervision strategy that decomposes the area matching task into classification and ranking subtasks. Finally, we introduce the Hierarchical Containment Redundancy Filter (HCRF) to eliminate overlapping areas by analyzing containment graphs. SGAD demonstrates remarkable performance gains, reducing runtime by 60x (0.82s vs. 60.23s) compared to MESA. Extensive evaluations show consistent improvements across multiple point matchers: SGAD+LoFTR reduces runtime compared to DKM, while achieving higher accuracy (0.82s vs. 1.51s, 65.98 vs. 61.11) in outdoor pose estimation, and SGAD+ROMA delivers +7.39% AUC@5° in indoor pose estimation, establishing a new state-of-the-art.

特征匹配区域描述符三维重建高效算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。