提升遥感图像持续学习的适应能力,缓解遗忘与僵化问题。
A Plasticity-Aware Method for Continual Self-Supervised Learning in Remote Sensing
- 分离特征维度为通用与专用部分,分别强化记忆稳定性和新任务适应性。
- 在任务增量和类别增量场景下,平均准确率提升1.12%~1.24%,顽固性降低2.01%~2.33%。
- 适合需要长期更新、避免模型僵化的遥感数据持续学习场景。
持续自监督学习(CSSL)在遥感领域日益受到关注,因其能从连续无标签数据流中逐次学习新任务。现有方法虽能防止灾难性遗忘,但多依赖正则化策略保留旧知识,削弱了模型对新任务数据的适应能力(即学习可塑性),导致性能下降。本文提出一种新型CSSL方法,兼顾序列学习与高可塑性。该方法采用融合解耦机制的知识蒸馏策略:先将特征维度划分为任务通用与任务专用部分;再强制通用特征相关以保障记忆稳定性,同时强制专用特征去相关以促进新特征学习。实验表明,在任务增量场景下,本方法相比广泛使用的CaSSLe框架,平均准确率提升1.12%,顽固性降低2.33%;在类别增量场景下,平均准确率提升1.24%,顽固性降低2.01%。
原文摘要 · Abstract (English)
Continual self-supervised learning (CSSL) methods have gained increasing attention in remote sensing (RS) due to their capability to learn new tasks sequentially from continuous streams of unlabeled data. Existing CSSL methods, while learning new tasks, focus on preventing catastrophic forgetting. To this end, most of them use regularization strategies to retain knowledge of previous tasks. This reduces the model's ability to adapt to the data of new tasks (i.e., learning plasticity), which can degrade performance. To address this problem, in this paper, we propose a novel CSSL method that aims to learn tasks sequentially, while achieving high learning plasticity. To this end, the proposed method uses a knowledge distillation strategy with an integrated decoupling mechanism. The decoupling is achieved by first dividing the feature dimensions into task-common and task-specific parts. Then, the task-common features are forced to be correlated to ensure memory stability while the task-specific features are forced to be de-correlated facilitating the learning of new features. Experimental results show the effectiveness of the proposed method compared to CaSSLe, which is a widely used CSSL framework, with improvements of up to 1.12% in average accuracy and 2.33% in intransigence in a task-incremental scenario, and 1.24% in average accuracy and 2.01% in intransigence in a class-incremental scenario.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。