arXiv:2604.14010cs.LGcs.CL2026-04ACL被引 2

动态调整参数隔离,缓解大模型微调中的遗忘与干扰。

Parameter Importance is Not Static: Evolving Parameter Isolation for Supervised Fine-Tuning

论文配图:Parameter Importance is Not Static: Evolving Parameter Isolation for Supervised Fine-Tuning
图 1 · 摘自论文原文
  • 根据梯度信号实时更新参数隔离掩码,动态保护关键参数。
  • 在多任务基准上显著降低任务干扰和灾难性遗忘。
  • 适合需要持续学习多个任务的大型语言模型应用。

大型语言模型的监督微调常面临任务干扰和灾难性遗忘问题。现有方法通过固定隔离任务关键参数来缓解,但假设参数重要性恒定,忽视了其随训练过程的变化。本文实证发现参数重要性存在时间漂移。为此提出演化参数隔离(EPI)框架,基于在线梯度信号定期更新隔离掩码,动态保护新出现的关键参数,同时释放过时参数以恢复模型可塑性。在多个多任务基准上的实验表明,相比静态隔离和标准微调,EPI consistently 减少干扰与遗忘,并提升整体泛化能力。分析强调隔离机制需同步学习动态过程。

原文摘要 · Abstract (English)

Supervised Fine-Tuning (SFT) of large language models often suffers from task interference and catastrophic forgetting. Recent approaches alleviate this issue by isolating task-critical parameters during training. However, these methods represent a static solution to a dynamic problem, assuming that parameter importance remains fixed once identified. In this work, we empirically demonstrate that parameter importance exhibits temporal drift over the course of training. To address this, we propose Evolving Parameter Isolation (EPI), a fine-tuning framework that adapts isolation decisions based on online estimates of parameter importance. Instead of freezing a fixed subset of parameters, EPI periodically updates isolation masks using gradient-based signals, enabling the model to protect emerging task-critical parameters while releasing outdated ones to recover plasticity. Experiments on diverse multi-task benchmarks demonstrate that EPI consistently reduces interference and forgetting compared to static isolation and standard fine-tuning, while improving overall generalization. Our analysis highlights the necessity of synchronizing isolation mechanisms with the evolving dynamics of learning diverse abilities.

模型微调参数隔离持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。