让模型在学新知识时避免旧知识混淆,提升持续学习能力。
Task-Agnostic Guided Feature Expansion for Class-Incremental Learning
- 用独立模型提取通用特征,供后续任务使用。
- 通过注意力机制融合通用与特定特征,提升多样性。
- 无需旧数据,适合实际持续学习场景。
在类增量学习(CIL)中,系统需在不遗忘已有知识的前提下学习新概念。近期方法通过扩展模型特征来应对新任务,但新旧特征易发生冲突导致误分类。现有方案受限于无法访问历史样本,仅依赖当前任务数据,难以获取多样化特征。为此,本文提出无任务特性的引导特征扩展框架(TagFex)。首先,利用独立模型持续捕捉任务无关特征;其次,通过融合注意力机制将任务无关特征与当前任务特征聚合,并将其回传至任务特定模型以增强表征多样性。大量实验表明,TagFex 在多种 CIL 设置下均表现优异。代码已开源:https://github.com/bwnzheng/TagFex_CVPR2025。
原文摘要 · Abstract (English)
The ability to learn new concepts while preserve the learned knowledge is desirable for learning systems in Class-Incremental Learning (CIL). Recently, feature expansion of the model become a prevalent solution for CIL, where the old features are fixed during the training of the new task while new features are expanded for the new tasks. However, such task-specific features learned from the new task may collide with the old features, leading to misclassification between tasks. Therefore, the expanded model is often encouraged to capture diverse features from the new task, aiming to avoid such collision. However, the existing solution is largely restricted to the samples from the current task, because of the poor accessibility to previous samples. To promote the learning and transferring of diverse features across tasks, we propose a framework called Task-Agnostic Guided Feature Expansion (TagFex). Firstly, it captures task-agnostic features continually with a separate model, providing extra task-agnostic features for subsequent tasks. Secondly, to obtain useful features from the task-agnostic model for the current task, it aggregates the task-agnostic features with the task-specific feature using a merge attention. Then the aggregated feature is transferred back into the task-specific feature for inference, helping the task-specific model capture diverse features. Extensive experiments show the effectiveness and superiority of TagFex on various CIL settings. Code is available at https://github.com/bwnzheng/TagFex_CVPR2025.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。