构建首个大规模无人机图像匹配对基准数据集,提升检索精度与三维重建质量。
UAVPairs: A Challenging Benchmark for Match Pair Retrieval of Large-scale UAV Images
- 基于3D重建生成几何相似性标签,确保图像对真实可匹配。
- 提出分批非平凡样本挖掘策略,显著降低训练开销。
- 设计排序列表损失函数,增强模型在复杂场景下的泛化能力。
本文提出一个具有挑战性的基准数据集UAVPairs及相应的训练流程,用于大规模无人机图像的匹配对检索。UAVPairs包含30个不同场景的21,622张高分辨率图像,利用基于SfM的3D重建生成的3D点和轨迹定义图像对间的几何相似性,确保训练所用图像对为真正可匹配对。针对全局难例挖掘成本高的问题,提出一种基于几何相似性和多场景结构的分批非平凡样本挖掘策略,有效加速训练过程。针对传统成对损失的局限性,设计了排序列表损失(ranked list loss),优化正负样本集构建的全局相似性结构。在三个独立的大规模无人机数据集上进行的综合实验表明,使用UAVPairs数据集和排序列表损失训练的模型,在检索精度上显著优于现有方法;该提升进一步转化为更强的视角图连通性与更高质量的3D重建结果。相比手工特征,新方法在重复纹理和弱纹理等挑战性场景中表现更稳健。相关代码与数据集将在https://github.com/json87/UAVPairs公开。
原文摘要 · Abstract (English)
The primary contribution of this paper is a challenging benchmark dataset, UAVPairs, and a training pipeline designed for match pair retrieval of large-scale UAV images. First, the UAVPairs dataset, comprising 21,622 high-resolution images across 30 diverse scenes, is constructed; the 3D points and tracks generated by SfM-based 3D reconstruction are employed to define the geometric similarity of image pairs, ensuring genuinely matchable image pairs are used for training. Second, to solve the problem of expensive mining cost for global hard negative mining, a batched nontrivial sample mining strategy is proposed, leveraging the geometric similarity and multi-scene structure of the UAVPairs to generate training samples as to accelerate training. Third, recognizing the limitation of pair-based losses, the ranked list loss is designed to improve the discrimination of image retrieval models, which optimizes the global similarity structure constructed from the positive set and negative set. Finally, the effectiveness of the UAVPairs dataset and training pipeline is validated through comprehensive experiments on three distinct large-scale UAV datasets. The experiment results demonstrate that models trained with the UAVPairs dataset and the ranked list loss achieve significantly improved retrieval accuracy compared to models trained on existing datasets or with conventional losses. Furthermore, these improvements translate to enhanced view graph connectivity and higher quality of reconstructed 3D models. The models trained by the proposed approach perform more robustly compared with hand-crafted global features, particularly in challenging repetitively textured scenes and weakly textured scenes. For match pair retrieval of large-scale UAV images, the trained image retrieval models offer an effective solution. The dataset would be made publicly available at https://github.com/json87/UAVPairs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。