arXiv:2506.02574eess.IVcs.CV2025-06被引 2

用时空嵌入自动生成动态遥感样本,解决静态标签过时问题

Dynamic mapping from static labels: remote sensing dynamic sample generation with temporal-spectral embedding

  • 先解耦再融合时空特征,学习正常地表的联合模式
  • 通过异常检测定位变化点,生成跨时间的动态训练样本
  • 可解释变化来源,适合遥感动态监测与模型更新场景

精准的遥感地理制图需要及时且具代表性的训练样本。然而地表快速变化常使静态样本在数月内失效,人工更新成本高且不可持续。为此,我们提出TasGen——一种两阶段的时空感知自动样本生成方法,仅需单时相静态标签即可无需人工干预生成动态样本。地表变化通常表现为时空序列中的异常,这些异常具有多变量但统一的特性:时序、光谱或联合异常由不同机制引发,不能简单耦合,否则会掩盖变化本质。但任一地表状态均对应一致的时空特征签名,若分开建模则会丢失该一致性。TasGen首先通过分层时空变分自编码器(HTS-VAE)实现双维度嵌入,解耦并联合学习正常样本的低维潜在模式;该嵌入可有效识别偏离联合模式的异常。第二阶段,利用稳定样本训练分类器,对时间序列中的变化点进行重标注,生成动态样本。为进一步解释变化成因,我们提出基于吉布斯采样的异常解释方法,可归因于特定时空维度的变化。

原文摘要 · Abstract (English)

Accurate remote sensing geographic mapping requires timely and representative samples. However, rapid land surface changes often render static samples obsolete within months, making manual sample updates labor-intensive and unsustainable. To address this challenge, we propose TasGen, a two-stage Temporal spectral-aware Automatic Sample Generation method for generating dynamic training samples from single-date static labels without human intervention. Land surface dynamics often manifest as anomalies in temporal-spectral sequences. %These anomalies are multivariate yet unified: temporal, spectral, or joint anomalies stem from different mechanisms and cannot be naively coupled, as this may obscure the nature of changes. Yet, any land surface state corresponds to a coherent temporal-spectral signature, which would be lost if the two dimensions are modeled separately. To effectively capture these dynamics, TasGen first disentangles temporal and spectral features to isolate their individual contributions, and then couples them to model their synergistic interactions. In the first stage, we introduce a hierarchical temporal-spectral variational autoencoder (HTS-VAE) with a dual-dimension embedding to learn low-dimensional latent patterns of normal samples by first disentangling and then jointly embedding temporal and spectral information. This temporal-spectral embedding enables robust anomaly detection by identifying deviations from learned joint patterns. In the second stage, a classifier trained on stable samples relabels change points across time to generate dynamic samples. To not only detect but also explain surface dynamics, we further propose an anomaly interpretation method based on Gibbs sampling, which attributes changes to specific spectral-temporal dimensions.

遥感动态样本时空嵌入异常检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。