arXiv:2606.21307cs.LGcs.AI2026-06

针对差异大的任务,动态分配技能避免遗忘。

Task-Differentiated Atomic Skill Expansion and Routing for Continual Learning Across Highly Heterogeneous Tasks

论文配图:Task-Differentiated Atomic Skill Expansion and Routing for Continual Learning Across Highly Heterogeneous Tasks
图 1 · 摘自论文原文
  • 按任务差异和不确定性动态增加新技能。
  • 19个异构任务上显著减少遗忘,提升适应性。
  • 适合处理任务差异大、格式多样的持续学习场景。

持续学习(CL)通常假设任务在语义或结构上相近,但在高度异构环境下,任务间推理方式和输入输出格式差异显著,现有方法常出现灾难性遗忘和容量分配低效问题。为此,我们提出任务差异化原子技能扩展与路由框架(TASER),联合决定每个任务应引入的新原子技能数量及激活哪些技能。该框架首先通过原子技能增量学习,根据任务差异和模型不确定性动态扩展能力;接着采用正交性增强的技能检测,确保技能语义独立且可复用;最后通过轻量级任务条件门控机制,动态组合任务相关技能。我们还构建了HeteroCLBench,一个包含19个跨9种认知维度的异构任务基准,采用标准化序列协议。在该基准上的实验表明,TASER consistently优于强基线,显著提升可塑性并减少灾难性遗忘。

原文摘要 · Abstract (English)

Continual learning (CL) is commonly studied under the assumption that sequential tasks are semantically related or structurally similar. However, in highly heterogeneous settings, where tasks differ substantially in reasoning patterns and input-output formats, existing methods often suffer from catastrophic forgetting and inefficient capacity allocation. To address this challenge, we propose Task-differentiated Atomic Skill Expansion and Routing (\texttt{TASER}), a CL framework that jointly determines how many new atomic skills to introduce for each task and which skills to activate. The framework first uses atomic skill incremental learning to dynamically expand capacity based on task divergence and model uncertainty. It then applies orthogonality-enhanced skill detection to ensure these skills remain semantically distinct and independently reusable. Finally, a skill dynamic routing mechanism composes task-relevant skills through lightweight task-conditioned gating. We further introduce \texttt{HeteroCLBench}, a highly heterogeneous benchmark for CL, comprising 19 diverse tasks across 9 cognitive dimensions under a standardized sequential protocol. Experiments on \texttt{HeteroCLBench} show that \texttt{TASER} consistently outperforms strong baselines by improving plasticity and reducing catastrophic forgetting.

持续学习技能扩展异构任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。