用跨领域交互提升土地表面动态预测,小算力下表现超越主流模型
StefaLand: An Efficient Geoscience Foundation Model That Improves Dynamic Land-Surface Predictions
- 基于位置感知的掩码自编码器融合静态与时序数据,抑制过拟合
- 在5个数据集上对径流、土壤湿度等4项任务均优于现有最优方法
- 仅需普通学术算力即可预训练,适合数据匮乏地区使用
管理自然资源和减轻洪水、干旱、火灾及滑坡风险,需要能准确预测气候驱动的地表响应。传统模型因依赖有限观测而难以泛化,且在概念漂移下性能下降。近期提出的视觉基础模型虽基于卫星影像,但计算量巨大,且不专为地表动态预测设计。我们提出Stefaland,一种以学习跨域交互为核心的生成式时空地球表示学习模型,可有效抑制过拟合。该模型在四个重要任务(径流、土壤湿度、土壤成分、滑坡)的五个数据集上表现出显著更强的空间泛化能力,优于此前最先进方法。其领域启发的设计包括:位置感知掩码自编码器融合静态与时间序列输入;基于属性而非图像的表示大幅降低计算需求;残差微调适配器增强跨任务知识迁移。Stefaland可在常规学术计算资源上预训练与微调,仍持续超越监督学习基线、微调后的视觉基础模型及商用嵌入,凸显了跨域交互的未被重视价值,为数据贫乏地区提供有力支持。
原文摘要 · Abstract (English)
Managing natural resources and mitigating risks from floods, droughts, wildfires, and landslides require models that can accurately predict climate-driven land-surface responses. Traditional models often struggle with spatial generalization because they are trained or calibrated on limited observations and can degrade under concept drift. Recently proposed vision foundation models trained on satellite imagery demand massive compute, and they are not designed for dynamic land surface prediction tasks. We introduce StefaLand, a generative spatiotemporal Earth representation learning model centered on learning cross-domain interactions to suppress overfitting. StefaLand demonstrates especially strong spatial generalization on five datasets across four important tasks: streamflow, soil moisture, soil composition and landslides, compared to previous state-of-the-art methods. The domain-inspired design choices include a location-aware masked autoencoder that fuses static and time-series inputs, an attribute-based rather than image-based representation that drastically reduces compute demands, and residual fine-tuning adapters that strengthen knowledge transfer across tasks. StefaLand can be pretrained and finetuned on commonly available academic compute resources, yet consistently outperforms state-of-the-art supervised learning baselines, fine-tuned vision foundation models and commercially available embeddings, highlighting the previously overlooked value of cross-domain interactions and providing assistance to data-poor regions of the world.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。