arXiv:2411.16064cs.CV2024-11CVPR被引 14

提出新方法解决增量学习中目标域知识干扰问题。

Multi-Granularity Class Prototype Topology Distillation for Class-Incremental Source-Free Unsupervised Domain Adaptation

  • 用多粒度原型自组织生成可靠伪标签
  • 通过拓扑蒸馏缓解新旧知识冲突,提升性能
  • 适合增量式无监督域适应场景,效果领先

本文研究类增量源域未知的无监督域适应(CI-SFUDA)问题,即目标域的无标签数据逐步到来,且无法访问源域有标签样本。该问题面临两大挑战:相似源类知识对目标类表示学习的干扰,以及新目标知识对旧知识的冲击。为此,提出多粒度类别原型拓扑蒸馏(GROTO)算法,有效将源域知识迁移到增量目标域。首先,通过建模累积分布挖掘正类,引入多粒度类别原型生成可靠伪标签,并促进目标特征自组织;其次,利用正类原型构建源与目标特征空间的拓扑结构,通过拓扑蒸馏持续缓解新知识对旧知识的冲击。大量实验表明,该方法在三个公开数据集上达到当前最优性能。代码已开源:https://github.com/dengpeihua/GROTO。

原文摘要 · Abstract (English)

This paper explores the Class-Incremental Source-Free Unsupervised Domain Adaptation (CI-SFUDA) problem, where the unlabeled target data come incrementally without access to labeled source instances. This problem poses two challenges, the interference of similar source-class knowledge in target-class representation learning and the shocks of new target knowledge to old ones. To address them, we propose the Multi-Granularity Class Prototype Topology Distillation (GROTO) algorithm, which effectively transfers the source knowledge to the class-incremental target domain. Concretely, we design the multi-granularity class prototype self-organization module and the prototype topology distillation module. First, we mine the positive classes by modeling accumulation distributions. Next, we introduce multi-granularity class prototypes to generate reliable pseudo-labels, and exploit them to promote the positive-class target feature self-organization. Second, the positive-class prototypes are leveraged to construct the topological structures of source and target feature spaces. Then, we perform the topology distillation to continually mitigate the shocks of new target knowledge to old ones. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance on three public datasets. Code is available at https://github.com/dengpeihua/GROTO.

增量学习域适应原型蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。