arXiv:2509.21413cs.LG2025-09中稿 · ICLR被引 2

无需数据即可持续融合模型,同时保持旧知识并适应新任务。

Null-Space Filtering for Data-Free Continual Model Merging: Preserving Stability, Promoting Plasticity

  • 通过空空间投影过滤任务向量,保留旧任务响应
  • 引入轻量LoRA适配器注入新任务信号,实现灵活适应
  • 无需额外参数与推理开销,适合资源受限场景

数据无关的持续模型融合(DFCMM)旨在不访问任务数据的情况下,将独立微调的模型融合为一个随新任务演进的统一主干网络。本文重新审视两个核心需求:稳定性(避免干扰旧任务)和可塑性(准确适应新任务)。现有方法未能解决如何在无数据条件下将数据级需求映射到参数空间优化的问题。为此,我们提出NUFILT(NUll-space FILTering),直接将这些需求嵌入参数空间优化。关键观察是任务向量近似对齐于表示子空间,提供了结构化替代方案以实现稳定性和可塑性。设计了空空间投影器,通过过滤新任务向量的重叠成分来保留先前响应,确保稳定性;进一步引入轻量级LoRA适配器,注入互补的任务特异性信号以实现可塑性。适配器采用基于投影的代理损失训练,保持与已有知识的一致性的同时引入新方向。这一联合滤波-适配过程使主干网络在吸收新知识的同时保留原有行为,更新以分层线性方式融合回主干,无需额外参数或推理开销。理论上建立了近似子空间对齐保证;实验表明,NUFILT在视觉与NLP基准上均达到当前最优性能,平均准确率相比OPCM和WUDI-Merging提升4-7%,接近微调效果,且计算开销更低。代码已开源。

原文摘要 · Abstract (English)

Data-free continual model merging (DFCMM) aims to fuse independently fine-tuned models into a single backbone that evolves with incoming tasks without accessing task data. This paper revisits two fundamental desiderata for DFCMM: stability, avoiding interference with earlier tasks, and plasticity, adapting faithfully to each new task. This poses a challenge that existing approaches fail to address: how to bridge data-level desiderata with parameter-space optimization to ensure stability and plasticity in the absence of task data. To this end, we propose NUFILT (NUll-space FILTering), a data-free framework that directly links these desiderata into parameter-space optimization. Our key observation is that task vectors approximately align with representation subspaces, providing structural surrogates for enforcing stability and plasticity. Accordingly, we design a null-space projector that preserves prior responses by filtering overlapping components of new task vectors, ensuring stability. We further introduce a lightweight LoRA adapter that injects complementary task-specific signals to enable plasticity. The adapter is trained with a projection-based surrogate loss that preserves consistency with prior knowledge while introducing novel directions. This joint filtering-adaptation process enables the backbone to absorb new knowledge while retaining existing behaviors, with updates fused back in a layer-wise linear fashion without extra parameters or inference cost. Theoretically, we establish approximate subspace alignment guarantees that justify null-space filtering. Empirically, NUFILT achieves state-of-the-art performance with minimal forgetting on both vision and NLP benchmarks, improving average accuracy by 4-7% over OPCM and WUDI-Merging, while narrowing the gap to fine-tuning and reducing computation overhead. The code is available at: https://github.com/zihuanqiu/NUFILT

模型融合持续学习无数据训练LoRA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。