统一建模遥感时空生成,一套模型搞定去云、重建、变化检测和预测。
UniTS: Unified Spatio-Temporal Generative Model for Remote Sensing
- 基于流匹配构建统一生成路径,条件驱动多任务建模。
- 在严重云遮蔽等挑战下性能显著优于专用模型。
- 适合遥感分析、环境监测等领域研究者使用。
卫星遥感的核心目标是捕捉地球环境的复杂动态,涵盖连续无云图像序列重建、地表覆盖变化检测及未来表面演变预测等任务。然而,现有方法通常针对不同任务设计专用模型,缺乏统一框架。本文提出统一时空生成模型UniTS,整合时间序列重建、去云、语义变化检测与预测四项核心任务。基于流匹配生成范式,UniTS在任务条件引导下构建从噪声到目标的确定性演化路径,实现多层级时空表示的统一建模。其架构采用带时空块的扩散变压器,设计自适应条件注入器(ACor)增强多模态输入感知能力,支持高质量可控生成;同时引入时空感知调制器(STM)提升时空依赖建模能力。在严重云污染、模态缺失及复杂物候变化预测等挑战场景下,显著优于现有专用模型。
原文摘要 · Abstract (English)
One of the primary objectives of satellite remote sensing is to capture the complex dynamics of the Earth environment, which encompasses tasks such as reconstructing continuous cloud-free image sequences, detecting land cover changes, and forecasting future surface evolution. However, existing methods typically require specialized models tailored to different tasks, and lack a general framework that can address these multi-level tasks from a unified perspective. In this paper, we propose a Unified Spatio-Temporal Generative Model (UniTS), which integrates several long-separated core tasks, including time series reconstruction, time series cloud removal, time series semantic change detection, and time series forecasting. Based on the flow matching generative paradigm, UniTS constructs a deterministic evolution path from noise to targets under the guidance of task-specific conditions, achieving unified modeling of spatiotemporal representations for multi-level tasks. The UniTS architecture consists of a diffusion transformer with spatiotemporal blocks, where we design an Adaptive Condition Injector (ACor) to enhance the model's conditional perception of multimodal inputs, enabling high-quality controllable generation. Additionally, we design a Spatiotemporal-aware Modulator (STM) to improve the ability of spatiotemporal blocks to capture complex spatiotemporal dependencies. It substantially outperforms existing specialized models, particularly under challenging conditions such as severe cloud contamination, modality absence, and forecasting complex phenological variations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。