提出新训练框架,提升无约束SfM中图像检索的几何匹配能力。
SupScene: Scene-Structured Overlap Supervision for Image Retrieval in Unconstrained SfM
- 基于场景重叠图采样局部子图,联合监督子图内所有图像对关系。
- 引入重叠排序目标函数,使描述符与几何共可见性更一致,提升检索精度。
- 设计轻量结构上下文探针池模块,生成紧凑全局描述符,适合实际应用。
图像检索是降低无约束运动恢复结构(SfM)中图像匹配二次计算成本的关键步骤。与通用图像检索不同,SfM的核心目标是识别可几何匹配的图像对,而非仅语义相似的图像。现有方法多采用以锚点为中心的三元组训练,围绕孤立三元组组织训练,未能充分利用SfM场景中自然形成的密集、分级重叠结构。本文提出SupScene,一种基于场景结构的训练框架,从SfM重叠图中采样连通局部子图,并联合监督子图内所有有效图像对关系。为显式对齐描述符与几何共可见性,进一步引入重叠排序目标函数,结合多相似性优化与连续相对重叠排序项。此外,框架通过轻量级结构上下文探针池(SCPP)头聚合互补结构响应,生成紧凑全局描述符。在多个基准上的实验表明,本方法显著提升整体检索性能,并增强下游SfM重建的完整性。代码与模型已开源。
原文摘要 · Abstract (English)
Image retrieval is a critical step for reducing the quadratic cost of image matching in unconstrained Structure-from-Motion (SfM). Unlike generic image retrieval, however, the relevant goal of SfM is to identify geometrically matchable image pairs rather than merely semantically similar images. Prevailing methods are largely trained under anchor-centric tuple guidance, which organizes the training around isolated tuples and under-utilizes the dense, graded overlap structure naturally established within a SfM scene. In this work, we present SupScene, a scene-structured training framework that samples connected local subgraphs from SfM overlap graphs and jointly supervises all valid within-subgraph pairwise relations. To explicitly align the trained descriptor with geometric co-visibility, we further introduce an overlap-ordered objective that combines multi-similarity optimization with a continuous relative-overlap ranking term. In addition, the proposed framework is instantiated with a lightweight Structural Context Probe Pooling (SCPP) head that aggregates complementary structural responses into a compact global descriptor. Extensive experimental results on multiple benchmarks demonstrate that our method can significantly improve overall retrieval performance and enhance the completeness of downstream SfM reconstructions. Code and models are available at https://github.com/Suxilan/SupScene.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。