提出TEA模型,让卫星影像分割适应不同时间长度序列。
TEA: Temporal Adaptive Satellite Image Semantic Segmentation
- 用教师-学生框架,动态调整输入时序长度以适应不同场景。
- 在多种时序长度下均显著提升分割准确率,最长提升12.3%。
- 适合需要跨区域、跨季节农业遥感分析的研究者使用。
基于卫星图像时序序列(SITS)的作物制图在农业生产中具有重要经济价值,其中地块分割是关键步骤。现有方法在固定时序长度下表现良好,但忽视了模型在不同时间长度场景下的泛化能力,导致在变长序列上分割效果显著下降。为此,我们提出TEA——一种时序自适应的SITS语义分割方法,以增强模型对时序长度变化的鲁棒性。通过引入一个蕴含全局序列知识的教师模型,指导学生模型在自适应时序输入下进行学习。具体地,教师通过中间嵌入、原型和软标签三个视角引导学生特征空间,实现知识迁移,并动态聚合学生模型以缓解知识遗忘。此外,引入全序列重建作为辅助任务,进一步提升不同长度输入下的表示质量。大量实验表明,该方法在常见基准上对不同长度输入均带来显著改进,最高提升达12.3%。代码将公开。
原文摘要 · Abstract (English)
Crop mapping based on satellite images time-series (SITS) holds substantial economic value in agricultural production settings, in which parcel segmentation is an essential step. Existing approaches have achieved notable advancements in SITS segmentation with predetermined sequence lengths. However, we found that these approaches overlooked the generalization capability of models across scenarios with varying temporal length, leading to markedly poor segmentation results in such cases. To address this issue, we propose TEA, a TEmporal Adaptive SITS semantic segmentation method to enhance the model's resilience under varying sequence lengths. We introduce a teacher model that encapsulates the global sequence knowledge to guide a student model with adaptive temporal input lengths. Specifically, teacher shapes the student's feature space via intermediate embedding, prototypes and soft label perspectives to realize knowledge transfer, while dynamically aggregating student model to mitigate knowledge forgetting. Finally, we introduce full-sequence reconstruction as an auxiliary task to further enhance the quality of representations across inputs of varying temporal lengths. Through extensive experiments, we demonstrate that our method brings remarkable improvements across inputs of different temporal lengths on common benchmarks. Our code will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。