用高频气象卫星数据训练出首个面向实时地球观测的通用模型
HighFM: Towards a Foundation Model for Learning Representations from High-Frequency Earth Observation Data

- 基于SEVIRI卫星数据,改进自编码框架学习时空特征
- 在云检测和火点识别任务中显著优于传统模型与现有遥感模型
- 适合需要快速响应的灾害监测场景,推动实时遥感应用
气候变化引发的灾害日益频繁严重,亟需实时监测与预警。地球观测(EO)结合卫星数据与机器学习,为应对挑战提供强大工具。基础模型(FM)通过大规模遥感数据预训练,已革新遥感领域。然而,现有模型多依赖高分辨率但重访率低的影像,难以捕捉快速变化现象及支持紧急响应。本文提出HighFM,首个针对高时频多光谱地球观测数据的基础模型。利用来自欧洲第二代气象卫星(MSG)平台的超过2TB SEVIRI影像,我们改进了SatMAE掩码自编码框架,以学习鲁棒的时空表示。为支持实时监测,引入细粒度时间编码,捕捉短期变化。预训练模型在云掩膜和活跃火点检测任务上进行微调。实验表明,相较于传统基线与近期地理空间基础模型,HighFM在平衡准确率和交并比(IoU)指标上均持续领先。结果证明,高密度时间序列静止轨道数据对实时地球观测具有巨大潜力,为灾害检测与追踪提供可扩展的基础模型路径。
原文摘要 · Abstract (English)
The increasing frequency and severity of climate related disasters have intensified the need for real time monitoring, early warning, and informed decision-making. Earth Observation (EO), powered by satellite data and Machine Learning (ML), offers powerful tools to meet these challenges. Foundation Models (FMs) have revolutionized EO ML by enabling general-purpose pretraining on large scale remote sensing datasets. However most existing models rely on high-resolution satellite imagery with low revisit rates limiting their suitability for fast-evolving phenomena and time critical emergency response. In this work, we present HighFM, a first cut approach towards a FM for high temporal resolution, multispectral EO data. Leveraging over 2 TB of SEVIRI imagery from the Meteosat Second Generation (MSG) platform, we adapt the SatMAE masked autoencoding framework to learn robust spatiotemporal representations. To support real time monitoring, we enhance the original architecture with fine grained temporal encodings to capture short term variability. The pretrained models are then finetuned on cloud masking and active fire detection tasks. We benchmark our SEVIRI pretrained Vision Transformers against traditional baselines and recent geospatial FMs, demonstrating consistent gains across both balanced accuracy and IoU metrics. Our results highlight the potential of temporally dense geostationary data for real-time EO, offering a scalable path toward foundation models for disaster detection and tracking.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。