arXiv:2503.11849cs.CV2025-03ICCV被引 61

构建首个统一的地球视觉基础模型,融合多源遥感数据与元信息。

Towards a Unified Copernicus Foundation Model for Earth Vision

  • 整合1870万张哨兵卫星图像,覆盖地表至大气层
  • 统一模型支持多光谱与非光谱模态,提升跨任务适应性
  • 提供15项分层评估任务,推动气象与气候研究融合

地球观测(EO)基础模型的发展使大规模卫星数据得以学习通用空间表征,广泛服务于各类地球应用。然而,现有工作多局限于固定光谱传感器,仅关注地表信息,忽视了影像之外的重要元数据。本文提出下一代EO基础模型的三大核心:1)Copernicus-Pretrain,一个包含1870万张对齐图像的超大规模预训练数据集,涵盖所有主要哨兵(Sentinel)任务,从地表延伸至大气层;2)Copernicus-FM,一种统一基础模型,通过扩展动态超网络和灵活元数据编码,可处理任意光谱或非光谱传感器模态;3)Copernicus-Bench,一套系统性评估基准,包含15项分层下游任务,覆盖各哨兵任务的预处理到专用应用。该数据集、模型与基准显著提升EO基础模型的可扩展性、多功能性与多模态适应能力,为连接地球观测、气象与气候研究创造新机遇。代码、数据与模型开源于 https://github.com/zhu-xlab/Copernicus-FM。

原文摘要 · Abstract (English)

Advances in Earth observation (EO) foundation models have unlocked the potential of big satellite data to learn generic representations from space, benefiting a wide range of downstream applications crucial to our planet. However, most existing efforts remain limited to fixed spectral sensors, focus solely on the Earth's surface, and overlook valuable metadata beyond imagery. In this work, we take a step towards next-generation EO foundation models with three key components: 1) Copernicus-Pretrain, a massive-scale pretraining dataset that integrates 18.7M aligned images from all major Copernicus Sentinel missions, spanning from the Earth's surface to its atmosphere; 2) Copernicus-FM, a unified foundation model capable of processing any spectral or non-spectral sensor modality using extended dynamic hypernetworks and flexible metadata encoding; and 3) Copernicus-Bench, a systematic evaluation benchmark with 15 hierarchical downstream tasks ranging from preprocessing to specialized applications for each Sentinel mission. Our dataset, model, and benchmark greatly improve the scalability, versatility, and multimodal adaptability of EO foundation models, while also creating new opportunities to connect EO, weather, and climate research. Codes, datasets and models are available at https://github.com/zhu-xlab/Copernicus-FM.

地球观测基础模型多模态遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。