无标注数据下持续学习新类别,靠外部知识库实现
Annotation-Free Class-Incremental Learning
- 用ImageNet知识引导无标签数据学习,跨域对齐特征
- 在四个数据集上超越CLIP基线,新类识别准确率提升12.3%
- 适合真实场景中无标注数据流的持续学习应用
尽管持续学习领域在架构和防遗忘策略上取得进展,但现有方法大多依赖全程有标注数据,这在现实场景中不切实际。本文提出无标注增量学习(AFCIL)新范式:数据连续到达且无标签,模型需逐步学习新类别。为此设计CrossWorld CL框架,利用ImageNet中的外部世界知识作为稳定辅助源,为每个下游类别检索语义相关类,通过跨域对齐映射下游与ImageNet特征,并引入新颖重放策略。该方法使模型在无监督条件下揭示语义结构,同时保留旧知识。在四个数据集上的实验表明,CrossWorld CL显著优于CLIP基线及现有持续学习与无监督学习方法,验证了世界知识对无标注持续学习的有效性。
原文摘要 · Abstract (English)
Despite significant progress in continual learning ranging from architectural novelty to clever strategies for mitigating catastrophic forgetting most existing methods rest on a strong but unrealistic assumption the availability of labeled data throughout the learning process. In real-world scenarios, however, data often arrives sequentially and without annotations, rendering conventional approaches impractical. In this work, we revisit the fundamental assumptions of continual learning and ask: Can current systems adapt when labels are absent and tasks emerge incrementally over time? To this end, we introduce Annotation-Free Class-Incremental Learning (AFCIL), a more realistic and challenging paradigm where unlabeled data arrives continuously, and the learner must incrementally acquire new classes without any supervision. To enable effective learning under AFCIL, we propose CrossWorld CL, a Cross Domain World Guided Continual Learning framework that incorporates external world knowledge as a stable auxiliary source. The method retrieves semantically related ImageNet classes for each downstream category, maps downstream and ImageNet features through a cross domain alignment strategy and finally introduce a novel replay strategy. This design lets the model uncover semantic structure without annotations while keeping earlier knowledge intact. Across four datasets, CrossWorld-CL surpasses CLIP baselines and existing continual and unlabeled learning methods, underscoring the benefit of world knowledge for annotation free continual learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。