arXiv:2608.27175cs.CV2026-08

研究遥感模型嵌入对时间跨度的敏感性,发现短期观测也能高效支持土地利用分类。

Temporal Sensitivity Analysis of Tessera Embeddings

论文配图:Temporal Sensitivity Analysis of Tessera Embeddings
图 1 · 摘自论文原文
  • 固定编码器,逐次缩短观测窗口重算嵌入,测试不同时间长度的效果
  • 作物分类任务中嵌入模型达58.3%交并比,比从头训练高46%
  • 短时嵌入仍具标签效率优势,适合近实时土地覆盖更新场景

许多地球观测应用需要精确且频繁更新的土地利用/土地覆盖图,而当前最强的地球观测基础模型通常基于一整年的观测构建嵌入。本文针对领先的基础模型Tessera,开展控制实验研究其在土地利用/土地覆盖制图中的时间敏感性。保持编码器冻结,将观测窗口从一年缩减至单日,重新计算嵌入,并以线性探测器和UNet分割头为下游任务,在LUCAS、DynamicEarthNet和PASTIS-R数据集上与从头训练网络对比。结果表明嵌入价值依赖任务:当类别由物候区分(如PASTIS-R作物类型)时,平均交并比达58.3%,比最优从头模型高出约46%;当类别时间稳定(如DynamicEarthNet和LUCAS的森林)时,仅在全监督下嵌入模型与从头模型表现相当。在两类数据集上,嵌入模型始终显著更标签高效。观测窗口缩短导致性能下降是渐进且类别相关的:从一年缩至一个月,PASTIS-R损失39%准确率,而DynamicEarthNet仅损失5%。单日嵌入在LUCAS上仍能实现3.4倍于随机水平的分类效果。研究表明,时间覆盖可作为可调成本而非固定前提,为近实时制图和更快的土地利用更新周期开辟可能。

原文摘要 · Abstract (English)

Many Earth Observation applications need land-use/land-cover maps that are both precise and frequently updated, yet the strongest Earth Observation foundation models build their embeddings from a full year of observations. We present a controlled study of the temporal sensitivity of Tessera, one of these leading foundation models, for land-use/land-cover mapping. Keeping the encoder frozen, we recompute its embeddings over varying observation windows, from a full year down to a single day. We use them as inputs to a linear probe and a UNet segmentation head, benchmarking both of them against from-scratch networks on LUCAS, DynamicEarthNet, and PASTIS-R datasets. We show that the value of the embeddings is task-dependent. Where classes are separated by phenology, as for the crop types of PASTIS-R, they reach a mean Intersection-over-Union of $58.3$, about $46\%$ above the best from-scratch model. Where classes are temporally stable (e.g., forests in DynamicEarthNet and LUCAS), embedding-based and from-scratch models match only under full supervision. On both datasets, Tessera embeddings remain markedly more label-efficient. Degradation under shorter temporal windows is gradual and class-dependent. Contracting the window from one year to one month costs $39\%$ of the segmentation accuracy on PASTIS-R but only $5\%$ on DynamicEarthNet. Single-day embeddings still classify land cover in LUCAS at $3.4$ times the chance level. Our study shows that temporal coverage is therefore a tunable cost rather than a fixed prerequisite, opening regimes such as near-real-time mapping and faster land-use/land-cover refresh cycles.

遥感土地利用嵌入时间敏感性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。