arXiv:2503.12706cs.CV2025-03被引 1

构建首个卫星图像匹配专用数据集,提升远距离视角差异下的匹配精度

SatDepth: A Novel Dataset for Satellite Image Matching

  • 提出基于图像旋转增强的数据平衡策略,解决卫星图像视角差异问题
  • 在旋转差异大的场景下,模型精度最高提升40%
  • 适合遥感图像匹配、深度学习训练数据构建的研究者使用

基于深度学习的图像匹配方法在复杂场景(如视角、光照、天气差异大)中表现优于传统算法。然而,现有数据集、学习框架和评估指标主要针对地面针孔相机拍摄的图像,尚未涵盖卫星图像。本文提出「SatDepth」,首个专为卫星图像匹配设计的数据集,提供密集真值对应关系。卫星图像具有多角度、多次重访的特点,为此我们引入新颖的图像旋转增强策略,使模型能在大幅旋转差异下仍能发现对应像素。我们在该数据集上对四种现有匹配框架进行基准测试,并通过消融实验验证:使用本数据集配合旋转增强训练的模型,在视角差异大时精度最高提升40%,显著优于其他数据集训练的结果。

原文摘要 · Abstract (English)

Recent advances in deep-learning based methods for image matching have demonstrated their superiority over traditional algorithms, enabling correspondence estimation in challenging scenes with significant differences in viewing angles, illumination and weather conditions. However, the existing datasets, learning frameworks, and evaluation metrics for the deep-learning based methods are limited to ground-based images recorded with pinhole cameras and have not been explored for satellite images. In this paper, we present ``SatDepth'', a novel dataset that provides dense ground-truth correspondences for training image matching frameworks meant specifically for satellite images. Satellites capture images from various viewing angles and tracks through multiple revisits over a region. To manage this variability, we propose a dataset balancing strategy through a novel image rotation augmentation procedure. This procedure allows for the discovery of corresponding pixels even in the presence of large rotational differences between the images. We benchmark four existing image matching frameworks using our dataset and carry out an ablation study that confirms that the models trained with our dataset with rotation augmentation outperform (up to 40% increase in precision) the models trained with other datasets, especially when there exist large rotational differences between the images.

卫星图像图像匹配数据集深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。