arXiv:2509.23592cs.LGcs.AI2025-09中稿 · ICCV被引 2

提出持续模型融合新框架,解决遗忘与扩容难题。

Toward a Holistic Approach to Continual Model Merging

  • 在微调、融合、修正三阶段干预,提升模型适应性。
  • 无需历史数据,仍能保留功能信息,性能优于传统方法。
  • 适合资源受限的持续学习场景,兼顾效率与可扩展性。

我们提出一种面向持续模型融合(CMM)的整体框架,从预融合、融合中到后融合三个关键阶段入手,应对持续学习中的两大核心挑战。传统方法或需维护不断增长的任务向量列表导致可扩展性差,或仅依赖权重空间合并而丢失重要功能信息。本方法首先在特定领域数据上对主模型进行切线空间微调,通过线性化增强任务间权重解耦,有效缓解跨任务干扰;融合过程中,利用可用优化器状态中的函数信息,而非仅参数平均,避免重访旧数据;最后,通过后融合校正消除融合前后表示差异,降低偏差并提升整体性能。整个过程在恒定内存约束下完成,无需访问历史数据。在标准类别增量与领域增量基准上的大量实验表明,该方法不仅表现优异,还提供了一种高效且可扩展的灾难性遗忘解决方案。

原文摘要 · Abstract (English)

We present a holistic framework for Continual Model Merging (CMM) that intervenes at three critical stages: pre-merging, during merging, and post-merging-to address two fundamental challenges in continual learning. In particular, conventional approaches either maintain a growing list of per-domain task vectors, leading to scalability issues or rely solely on weight-space merging when old data is inaccessible, thereby losing crucial functional information. Our method overcomes these limitations by first fine-tuning the main model within its tangent space on domain-specific data; this linearization amplifies per-task weight disentanglement, effectively mitigating across-task interference. During merging, we leverage functional information from available optimizer states beyond mere parameter averages to avoid the need to revisit old data. Finally, a post-merging correction aligns the representation discrepancy between pre- and post-merged models, reducing bias and enhancing overall performance-all while operating under constant memory constraints without accessing historical data. Extensive experiments on standard class-incremental and domain-incremental benchmarks demonstrate that our approach not only achieves competitive performance but also provides a scalable and efficient solution to the catastrophic forgetting problem.

持续学习模型融合灾难性遗忘高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。