arXiv:2605.10184cs.CVcs.AI2026-05

用荷兰高分遥感数据训练出可通用的遥感基础模型。

Developing a foundation model for high-resolution remote sensing data of the Netherlands

论文配图:Developing a foundation model for high-resolution remote sensing data of the Netherlands
图 1 · 摘自论文原文
  • 结合CNN与ViT捕捉地貌细节与大尺度结构特征。
  • 利用时间序列信息提升小样本下的泛化能力,性能优于单时相输入。
  • 模型参数少但表现媲美主流模型,适合资源有限的研究者使用。

我们基于1.2米分辨率的荷兰卫星影像构建了一个基础模型。通过融合卷积神经网络与视觉变换器,模型同时捕获低频与高频地表特征,如细纹理、边缘、小型物体以及地形结构、高程模式和土地覆盖分布。引入时间序列作为输入,使模型学习跨时间的上下文信息,有效利用地形特征、土地覆盖变化及季节动态等时序依赖关系。这些约束降低了特征歧义性,增强了表征学习能力,并在标注样本较少时实现更好泛化。该模型在多个下游任务上评估,涵盖荷兰本地应用与全球基准数据集。在荷兰植被监测数据集上,使用时间信息显著提升性能;尽管模型规模较小且预训练数据仅限荷兰,其在全球基准上仍达到与顶尖模型相当的水平。结果表明,该模型可在有限数据下学习丰富通用表征,以更少参数实现优异表现。为促进可复现性与再利用,相关代码与模型已公开于GitHub。

原文摘要 · Abstract (English)

We develop a foundation model using 1.2m high resolution satellite images of the Netherlands. By combining a Convolutional Neural Network and a Vision Transformer, the model captures both low- and high-frequency landscape features, such as fine textures, edges, and small objects as well as large terrain structures, elevation patterns, and land-cover distributions. Leveraging temporal data as input, the model learns from broader contextual information across time, allowing the model to exploit the temporal dependencies, such as topographic features, land-cover changes, and seasonal dynamics. These additional constraints reduce feature ambiguity, improve representation learning, and enable better generalization with fewer labeled samples. The foundation model is evaluated on multiple downstream tasks, ranging from use cases within the Netherlands to global benchmarking datasets. On the vegetation monitoring dataset of the Netherlands, the model shows clear performance improvements by incorporating temporal information instead of relying on a single time point. Despite using a smaller model and less pretraining data limited to the Netherlands, it achieves competitive results on global benchmarks when compared to state-of-the-art models. These results demonstrate that the model can learn rich, generalizable representations from limited data, achieving competitive performance on global benchmarks while using a fraction of the parameters of larger state-of-the-art remote sensing models. To maximize reproducibility and reuse, we made the scripts and the model accessible on GitHub.

遥感基础模型时间序列小样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。