arXiv:2506.20380cs.LG2025-06被引 48

TESSERA用时间嵌入分析卫星遥感数据,提升植被监测精度。

TESSERA: Temporal Embeddings of Surface Spectra for Earth Representation and Analysis

  • 通过随机采样和对比学习,学习对观测缺失鲁棒的像素级嵌入。
  • 在分类、分割等任务中仅需少量标签即达顶尖性能。
  • 开源全球10米分辨率嵌入数据,支持大规模地球分析。

光学与微波遥感时间序列常因轨道周期和云遮挡导致数据不规则。传统拼接方法虽缓解此问题,却损失植被物候信息,影响下游任务。为此,我们提出TESSERA,一种面向多模态(Sentinel-1/2)遥感时间序列的像素级基础模型,可学习鲁棒且标签高效的时间嵌入。训练中采用Barlow Twins框架与稀疏随机时间采样,强化对有效观测选择的不变性;引入全局打乱正则化以解耦空间邻域相关性,以及基于混合的调节策略以增强极端稀疏条件下的不变性。实验表明,TESSERA在多种分类、分割与回归任务中表现优异,具备高标签效率,通常仅需小型任务头与极低计算开销。为推动开放科学,我们发布全球、年度、10米分辨率、像素级int8嵌入数据,附带开源权重、代码及轻量适配头,支持行星尺度的大规模检索与推理。所有资源见:https://github.com/ucam-eo/tessera。

原文摘要 · Abstract (English)

Satellite Earth-observation (EO) time series in the optical and microwave ranges of the electromagnetic spectrum are often irregular due to orbital patterns and cloud obstruction. Compositing addresses these issues but loses information with respect to vegetation phenology, which is critical for many downstream tasks. Instead, we present TESSERA, a pixel-wise foundation model for multi-modal (Sentinel-1/2) EO time series that learns robust, label-efficient embeddings. During model training, TESSERA uses Barlow Twins and sparse random temporal sampling to enforce invariance to the selection of valid observations. We employ two key regularizers: global shuffling to decorrelate spatial neighborhoods and mix-based regulation to improve invariance under extreme sparsity. We find that for diverse classification, segmentation, and regression tasks, TESSERA embeddings deliver state-of-the-art accuracy with high label efficiency, often requiring only a small task head and minimal computation. To democratize access, adhere to FAIR - principles, and simplify use, we release global, annual, 10m, pixel-wise int8 embeddings together with open weights/code and lightweight adaptation heads, thus providing practical tooling for large-scale retrieval and inference at planetary scale. All code and data are available at: https://github.com/ucam-eo/tessera.

遥感时间序列嵌入地球观测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。