arXiv:2603.22097cs.AIcs.LG2026-03中稿 · IEEE IGARSS 2026被引 2

用物理约束的光谱掩码提升遥感大模型可信度

SpecTM: Spectral Targeted Masking for Trustworthy Foundation Models

  • 设计光谱目标掩码,让模型从跨波段信息重建特定波段
  • 预测湖藻毒素浓度时,8天后预测R²达0.62,比基线高99%
  • 在标签极稀缺时效率提升2.2倍,适合遥感与环境建模

基础模型在地球观测(EO)领域日益普及,但通常依赖随机掩码,未显式引入物理约束,影响其可信度,尤其在指导公共卫生决策的预测模型中。本文提出光谱目标掩码(SpecTM),一种融入物理先验的掩码设计,旨在预训练阶段通过跨光谱上下文重建目标波段。我们构建了一个可扩展的多任务自监督学习框架,联合优化波段重建、生物光学指数推断及8天后时间预测任务,利用NASA PACE湖埃里湖高光谱影像进行评估。结果表明,SpecTM在当前周预测中达到R²=0.695,8天后预测达R²=0.62,分别优于基线模型34%(0.51岭回归)和99%(支持向量回归0.31)。消融实验显示,目标掩码相较随机掩码提升0.037 R²。此外,在极端数据稀缺下,其标签效率为强基线的2.2倍。该方法实现跨地球观测领域的物理感知表征学习,提升模型可解释性。

原文摘要 · Abstract (English)

Foundation models are now increasingly being developed for Earth observation (EO), yet they often rely on stochastic masking that do not explicitly enforce physics constraints; a critical trustworthiness limitation, in particular for predictive models that guide public health decisions. In this work, we propose SpecTM (Spectral Targeted Masking), a physics-informed masking design that encourages the reconstruction of targeted bands from cross-spectral context during pretraining. To achieve this, we developed an adaptable multi-task (band reconstruction, bio-optical index inference, and 8-day-ahead temporal prediction) self-supervised learning (SSL) framework that encodes spectrally intrinsic representations via joint optimization, and evaluated it on a downstream microcystin concentration regression model using NASA PACE hyperspectral imagery over Lake Erie. SpecTM achieves R^2 = 0.695 (current week) and R^2 = 0.620 (8-day-ahead) predictions surpassing all baseline models by (+34% (0.51 Ridge) and +99% (SVR 0.31)) respectively. Our ablation experiments show targeted masking improves predictions by +0.037 R^2 over random masking. Furthermore, it outperforms strong baselines with 2.2x superior label efficiency under extreme scarcity. SpecTM enables physics-informed representation learning across EO domains and improves the interpretability of foundation models.

遥感大模型自监督学习物理约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。