arXiv:2506.21312cs.CV2025-06中稿 · IEEE Geoscience an…被引 1

用自监督方法提升遥感图像持续学习,避免遗忘且无需大量标注数据。

Continual Self-Supervised Learning with Masked Autoencoders in Remote Sensing

  • 通过图像和模型权重混合增强旧任务信息保留。
  • 在遥感任务上相比现有方法最高提升4.94%准确率。
  • 适合标注稀缺的遥感场景持续学习研究者使用。

持续学习(CL)旨在从连续获取的训练数据中顺序学习新任务,近年来在遥感(RS)领域受到广泛关注。现有遥感持续学习方法虽能缓解灾难性遗忘,但依赖大量标注样本,成本高且难以获取。为此,本文提出一种基于掩码自编码器(MAE)的新型持续自监督学习方法——CoSMAE。该方法包含两个组件:数据混合(data mixup),通过将当前任务与先前任务的图像进行插值,保留历史数据分布;模型混合知识蒸馏(model mixup knowledge distillation),通过插值过去模型与当前模型的权重生成教师模型,同时蒸馏旧知识。二者在数据与模型层面协同正则化,提升跨任务泛化能力并降低遗忘风险。实验表明,CoSMAE 在应用于 MAE 时,相较先进持续学习方法最高提升达 4.94%。代码已公开于 https://git.tu-berlin.de/rsim/CoSMAE。

原文摘要 · Abstract (English)

The development of continual learning (CL) methods, which aim to learn new tasks in a sequential manner from the training data acquired continuously, has gained great attention in remote sensing (RS). The existing CL methods in RS, while learning new tasks, enhance robustness towards catastrophic forgetting. This is achieved by using a large number of labeled training samples, which is costly and not always feasible to gather in RS. To address this problem, we propose a novel continual self-supervised learning method in the context of masked autoencoders (denoted as CoSMAE). The proposed CoSMAE consists of two components: i) data mixup; and ii) model mixup knowledge distillation. Data mixup is associated with retaining information on previous data distributions by interpolating images from the current task with those from the previous tasks. Model mixup knowledge distillation is associated with distilling knowledge from past models and the current model simultaneously by interpolating their model weights to form a teacher for the knowledge distillation. The two components complement each other to regularize the MAE at the data and model levels to facilitate better generalization across tasks and reduce the risk of catastrophic forgetting. Experimental results show that CoSMAE achieves significant improvements of up to 4.94% over state-of-the-art CL methods applied to MAE. Our code is publicly available at: https://git.tu-berlin.de/rsim/CoSMAE.

持续学习遥感自监督掩码自编码器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。