arXiv:2608.31096cs.CVcs.LG2026-08

用一个共享适配器实现持续学习,动态调整特征分布避免遗忘。

One Adapter, Many Tasks: Task-Conditioned Feature Transformations for Continual Learning

论文配图:One Adapter, Many Tasks: Task-Conditioned Feature Transformations for Continual Learning
图 1 · 摘自论文原文
  • 设计动态任务条件特征变换,统一处理多个任务的特征映射。
  • 在200个任务序列上参数减少90%以上,仍保持高准确率。
  • 无需重放数据,适合资源受限场景,尤其适合长期持续学习。

类增量学习(CIL)要求模型在不访问旧数据的情况下逐步学习包含新类的任务,同时保留对所有已见类的识别能力。现有方法多基于冻结主干网络并添加轻量可训练模块,但存在两类缺陷:任务专用适配器虽能生成明确任务特征,却导致参数与计算效率低下;而基于LoRA的融合方法将各任务参数合并为单一模型,其静态聚合权重在推理时引发特征干扰。为此,我们提出FACET:任务条件特征变换与一致性机制,通过单个共享适配器实现高效特征动态调整,在持续学习中形成无重叠的任务特异性特征混合分布。同时引入免重放的任务条件特征一致性损失,缓解适配器特征空间中的灾难性遗忘。即使仅维护一个适配器,FACET在长达200个任务的序列和标准20任务序列上均表现优异,显著降低可训练参数量与GFLOPs。代码将在录用后开源。

原文摘要 · Abstract (English)

Class-incremental learning (CIL) requires a model to incrementally learn tasks that contain new classes without accessing earlier training data while preserving the ability to recognize all seen classes. Recently, pretrained-model-based approaches have become prevalent by adapting a frozen backbone with additional lightweight trainable modules. Existing methods, however, exhibit limitations: task-specific adapters learn explicit per-task representations but are parameter- and computation-inefficient, while LoRA-based merging methods combine per-task LoRA parameters into a single model whose static aggregated weights cause representation interference during inference. To address these problems, we present \textbf{FACET}: task-conditioned \textbf{F}e\textbf{A}ture transformation with \textbf{C}ondition\textbf{E}d feature consis\textbf{T}ency, achieving excellent parameter efficiency while producing highly discriminative features during inference. When continually trained on a task sequence, FACET learns a single shared adapter that employs a dynamic task-conditioned feature transformation, shaping the overall feature distribution of the adapter into a mixture of overlap-reduced task-specific components. On the other hand, we propose an efficient replay-free task-conditioned feature consistency loss, aiming to mitigate catastrophic forgetting of the learned mixture distribution in the adapter's feature space. Even when maintaining only a single adapter, FACET demonstrates robust scalability. On both very long task sequences (e.g., 200 tasks) and standard short task sequences (e.g., 20 tasks), our method achieves superior performance while using significantly fewer trainable parameters and GFLOPs. The code will be made open source upon acceptance.

持续学习特征变换轻量化适配器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。