面对学习冲突,用多模型分工协作解决持续学习中的遗忘问题
Socialized Division and Collaboration: Rethinking Class-Incremental Learning under Optimization Conflicts

- 将不同学习阶段分配给专用模型,避免优化方向冲突
- 基于自由能原理动态分配任务,实现模型协同进化
- 适合存在强烈学习冲突的长期持续学习场景
类增量学习通常采用单模型范式,即一个统一模型逐步适应无界的学习会话流。当连续会话引发不相容的优化方向时,该范式在剧烈分布偏移下表现受限,导致破坏性干扰和灾难性遗忘。我们指出,这种遗忘源于在单一参数空间中强制异质学习动态的结构性缺陷。受社会团结理论启发,提出社会分化与协作(SDC)框架,针对优化冲突将会话学习分解至专业化模型,并实现协调协作。为此引入基于赫尔姆霍兹自由能的能量型会话-模型兼容性准则,指导在冲突目标下的自适应会话分配与模型演化。该框架整合会话分配、模型演化与协同推理,形成统一流程,为持续学习提供替代单体范式的新思路,并揭示了应对持久优化冲突的通用设计原则。
原文摘要 · Abstract (English)
Class-incremental learning is commonly instantiated as a single-model paradigm, where a unified model sequentially adapts to an unbounded stream of sessions. While effective under mild distributional shifts, this formulation becomes strained when successive sessions induce incompatible optimization directions, leading to destructive interference and catastrophic forgetting. We argue that such forgetting reflects a structural limitation of enforcing heterogeneous learning dynamics within a single parameter space. Motivated by social solidarity theory, we propose Socialized Division and Collaboration (SDC) as a reformulation of continual learning that decomposes session learning across specialized models in response to optimization conflicts, while enabling coordinated collaboration. To support this formulation with a principled allocation mechanism, we introduce an energy-based session-model compatibility criterion grounded in Helmholtz free energy, which guides adaptive session allocation and model evolution under conflicting objectives. This framework integrates session assignment, model evolution, and collaborative inference into a unified pipeline, offering an alternative to monolithic continual learning formulations and highlighting a broader design principle for learning under persistent optimization conflicts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。