arXiv:2510.21813cs.CVcs.AI2025-10

用生成式解码器统一处理多任务遥感时序数据,效果超越大型模型。

SITS-DECO: A Generative Decoder Is All You Need For Multitask Satellite Image Time Series Modelling

  • 仅用GPT风格解码器,将遥感时序数据统一为序列建模。
  • 在PASTIS-R数据集上分类准确率超越更复杂的大模型。
  • 无需额外适配,支持多模态、多任务,适合轻量级遥感应用。

地球观测(EO)基础建模有望简化并提升多样现实任务中对地球观测数据的使用。然而,现有多数模型需额外适配,且结构固定于特定数据源或训练方式。为此,我们借鉴大语言模型思想,通过统一序列的下一步词预测,隐式捕捉多样任务(预训练与下游)。提出SITS-DECO(卫星图像时序-仅解码器),一个概念验证型生成式模型,将此统一序列框架应用于地球观测数据。采用简单GPT风格解码器架构,展示其在纯生成框架下完成像素级、多时相、多模态作物类型分类等有用任务的能力。通过符号提示,证明该模型可在单一统一架构中执行多种监督与自监督任务,无需任务或模态特异性适配。尽管缺乏空间上下文信息,SITS-DECO在作物类型分类(PASTIS-R)上仍优于更大规模的地球观测基础模型,表明密集时序建模是当前范式中缺失的关键要素。本工作体现一种以数据为中心的建模范式:能力源于训练数据的多样性与结构,而非架构复杂性。SITS-DECO提供了一条轻量、实用的多模态、多任务地球观测建模路径,并为未来生成式地球观测基础模型提供了概念桥梁。

原文摘要 · Abstract (English)

Earth Observation (EO) Foundation Modelling (FM) holds great promise for simplifying and improving the use of EO data for diverse real-world tasks. However, most existing models require additional adaptation before they can be used and are structured rigidly around particular data sources or training approaches. To address this, we take inspiration from large language models, where diverse tasks, both pre-training and downstream, are implicitly captured through next-token prediction over unified token sequences, leveraging the structure and diversity of the training data. We introduce SITS-DECO (Satellite Image Time Series-DECoder Only), a proof-of-concept generative model that applies this unified-sequence framing to EO data. Using a simple GPT-style decoder-only architecture, and demonstrate its ability to perform useful EO tasks (pixel-wise, multi-temporal, multi-modal crop-type classification) in a purely generative framework. Through symbolic prompting, we show that the model can perform multiple supervised and self-supervised tasks within a single unified architecture, without task- or modality-specific adaptation. Despite its simplicity and lack of spatial context, SITS-DECO outperforms much larger EO foundation models on crop-type classification (PASTIS-R) demonstrating that dense temporal sequence modelling is a critical missing ingredient in the current paradigm. This work exemplifies a data-centric modelling paradigm in which capability arises from the diversity and structure of the training data rather than from architectural complexity. SITS-DECO provides a lightweight, practical route to multi-modal, multi-task EO modelling, and a conceptual bridge toward future generative EO foundation models.

遥感生成模型多任务时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。