arXiv:2502.07003cs.CV2025-02ICCV被引 2

用宇航员照片训练模型,大幅提升地球影像定位精度。

AstroLoc: Robust Space to Ground Image Localizer

  • 利用30万张弱标注宇航员照片自动构建定位数据集,训练新模型AstroLoc。
  • recall@1提升35%,recall@100超99%,显著超越现有最佳方法。
  • 无需微调即可用于太空失联卫星、历史影像等关联任务。

宇航员每天从国际空间站拍摄数千张地球照片,经定位后广泛应用于气候变化研究与灾害管理。传统定位依赖人工,近年转向图像检索:给定一张宇航员照片,在海量地理标记的卫星图像库中寻找最相似匹配,即宇航员摄影定位(APL)任务。然而现有APL方法仅用卫星图像训练,未利用数百万开源宇航员照片。本文提出首个能利用宇航员照片进行训练的APL流程:首先通过自动化管道为30万张手动弱标注的宇航员照片生成完整定位信息,再基于这些数据训练名为AstroLoc的模型。AstroLoc通过双重损失学习鲁棒的地表特征表示:一是宇航员照片与其对应卫星图像的成对损失;二是基于无监督挖掘加权的卫星图像聚类损失。实验表明,AstroLoc在recall@1上相比前人最优方法提升35%,recall@100稳定超过99%。此外,不需微调,AstroLoc在失联卫星定位与历史空间影像定位等任务中也表现优异。

原文摘要 · Abstract (English)

Astronauts take thousands of photos of Earth per day from the International Space Station, which, once localized on Earth's surface, are used for a multitude of tasks, ranging from climate change research to disaster management. The localization process, which has been performed manually for decades, has recently been approached through image retrieval solutions: given an astronaut photo, find its most similar match among a large database of geo-tagged satellite images, in a task called Astronaut Photography Localization (APL). Yet, existing APL approaches are trained only using satellite images, without taking advantage of the millions open-source astronaut photos. In this work we present the first APL pipeline capable of leveraging astronaut photos for training. We first produce full localization information for 300,000 manually weakly labeled astronaut photos through an automated pipeline, and then use these images to train a model, called AstroLoc. AstroLoc learns a robust representation of Earth's surface features through two losses: astronaut photos paired with their matching satellite counterparts in a pairwise loss, and a second loss on clusters of satellite imagery weighted by their relevance to astronaut photography via unsupervised mining. We find that AstroLoc achieves a staggering 35% average improvement in recall@1 over previous SOTA, pushing the limits of existing datasets with a recall@100 consistently over 99%. Finally, we note that AstroLoc, without any fine-tuning, provides excellent results for related tasks like the lost-in-space satellite problem and historical space imagery localization.

图像定位地球观测多模态学习空间影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。