构建可信赖的遥感基础模型,强调物理规律与多模态数据融合。
Scalable and Trustworthy Earth Observation Foundation Models

- 基于遥感物理特性设计领域自适应模型架构
- 实证表明无单一模型在所有任务中表现最优
- 适合关注遥感可信推理与跨模态迁移的研究者
基础模型(FMs)已推动机器学习从特定任务模型转向通用预训练模型,适用于卫星与航空影像数据量大、重访频率高且日益多模态的地球观测(EO)领域。由于真实地面标签稀疏,遥感基础模型(RSFMs)缺乏领域适配时难以可靠迁移。这是因为遥感数据受测量物理和运行决策约束。本文梳理了遥感领域基础模型的设计原则,涵盖预训练目标、模型架构、下游适配及可信性要求。结合最新基准测试显示,不存在通用最优地理空间基础模型,评估不一致仍是公平比较与可靠部署的主要障碍。通过两个案例说明:基于物理信息的光谱目标掩码用于有害藻华预测,强化学习优化环境监测站选址。未来RSFMs需兼顾基准准确率、模态感知迁移能力与物理合理的表征,以支持可信的地球观测决策。
原文摘要 · Abstract (English)
Foundation models (FMs) have transformed machine learning from isolated task-specific model development toward general-purpose models pretrained on broad data and adapted to multiple downstream tasks. Earth observation (EO) is an important domain for this paradigm because satellite and airborne archives are large, high-revisit, and increasingly multimodal, while reliable field labels are often sparse. Remote sensing foundation models (RSFMs) cannot be transferred reliably/optimally without domain-specific adaptation. This is because EO data are governed by measurement physics and operational decision constraints. This chapter reviews the design principles arising from these domain-specific constraints. It first defines the FMs paradigm in remote sensing (RS), then synthesizes the current model landscape, pretraining objectives, architecture designs, downstream adaptation and trustworthiness requirements. The chapter also incorporates recent benchmark evidence showing that no single geospatial foundation model is universally best and that inconsistent evaluation remains a major issue to fair comparison and reliable deployment. In addition, two brief environmental monitoring case studies; physics-informed spectral targeted masking for harmful algal bloom prediction and reinforcement learning for adaptive environmental monitoring station selection to illustrate the FMs domain-guided principles in practice. This chapter posits that next-generation RSFMs should be evaluated not only by benchmark accuracy, but also by modality-aware transfer and physically plausible representations for trustworthy EO decisions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。