CasP通过分阶段匹配提升半密集特征匹配精度与速度。
CasP: Improving Semi-Dense Feature Matching Pipeline Leveraging Cascaded Correspondence Priors for Guidance

- 分两阶段匹配,用注意力机制聚焦候选区域,减少搜索范围。
- 在1152分辨率下比最高效方法快2.2倍,且高分辨率加速更明显。
- 适合对延迟和鲁棒性要求高的SLAM、无人机等场景使用。
半密集特征匹配方法在复杂场景中表现优异,但现有流程依赖在整个特征图上进行全局搜索以建立粗匹配,限制了精度与效率的进一步提升。针对这一局限,本文提出新框架CasP,利用级联对应先验进行引导。匹配过程分为两个渐进阶段,中间通过基于区域的选激活交叉注意力机制增强特征区分度。第二阶段将一对一匹配限制在第一阶段识别的一对多先验区域内。此外,该框架融合高层特征,有助于降低低层特征提取的计算成本。在更高分辨率下,CasP的加速效果更显著,在1152分辨率下较最高效方法ELoFTR实现约2.2倍提速。大量实验表明其在几何估计方面具有优势,尤其具备出色的跨域泛化能力。这些特性使其适用于对延迟敏感且需高鲁棒性的应用,如SLAM和无人机系统。代码已开源:https://github.com/pq-chen/CasP。
原文摘要 · Abstract (English)
Semi-dense feature matching methods have shown strong performance in challenging scenarios. However, the existing pipeline relies on a global search across the entire feature map to establish coarse matches, limiting further improvements in accuracy and efficiency. Motivated by this limitation, we propose a novel pipeline, CasP, which leverages cascaded correspondence priors for guidance. Specifically, the matching stage is decomposed into two progressive phases, bridged by a region-based selective cross-attention mechanism designed to enhance feature discriminability. In the second phase, one-to-one matches are determined by restricting the search range to the one-to-many prior areas identified in the first phase. Additionally, this pipeline benefits from incorporating high-level features, which helps reduce the computational costs of low-level feature extraction. The acceleration gains of CasP increase with higher resolution, and our lite model achieves a speedup of $\sim2.2\times$ at a resolution of 1152 compared to the most efficient method, ELoFTR. Furthermore, extensive experiments demonstrate its superiority in geometric estimation, particularly with impressive cross-domain generalization. These advantages highlight its potential for latency-sensitive and high-robustness applications, such as SLAM and UAV systems. Code is available at https://github.com/pq-chen/CasP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。