无需旧数据的持续学习方法,通过神经冗余控制模型更新范围,兼顾新任务适应与旧知识保留。
PLATE: Plasticity-Tunable Efficient Adapters for Geometry-Aware Continual Learning
- 利用预训练模型的神经冗余构建可保护的更新子空间,无需访问旧数据。
- 通过限制更新范围,使模型在新任务上表现良好且旧任务保留率显著提升。
- 适用于大模型持续迭代场景,尤其适合无法获取历史数据的部署环境。
我们提出一种针对预训练模型的持续学习方法,无需访问旧任务数据,解决了基础模型适配中预训练分布不可得的实际难题。关键观察是:预训练网络存在显著的几何冗余,这种冗余可从两个互补角度利用。其一,冗余神经元提供了预训练时期特征方向的代理,可直接从预训练权重构建近似受保护的更新子空间;其二,冗余为更新位置提供自然先验:通过将更新限制在部分冗余神经元,并约束其余自由度,获得具有更低功能漂移和更好最差情况保留保证的更新族。由此诞生的 extsc{PLATE}(Plasticity-Tunable Efficient Adapters)是一种无需旧数据的持续学习方法,可显式调控塑性与保留之间的权衡。每个层通过结构化低秩更新 $ΔW = B A Q^ op$ 参数化,其中 $B$ 与 $Q$ 由预训练权重一次性计算并冻结,仅训练 $A$。代码已公开于 https://github.com/SalesforceAIResearch/PLATE。
原文摘要 · Abstract (English)
We develop a continual learning method for pretrained models that \emph{requires no access to old-task data}, addressing a practical barrier in foundation model adaptation where pretraining distributions are often unavailable. Our key observation is that pretrained networks exhibit substantial \emph{geometric redundancy}, and that this redundancy can be exploited in two complementary ways. First, redundant neurons provide a proxy for dominant pretraining-era feature directions, enabling the construction of approximately protected update subspaces directly from pretrained weights. Second, redundancy offers a natural bias for \emph{where} to place plasticity: by restricting updates to a subset of redundant neurons and constraining the remaining degrees of freedom, we obtain update families with reduced functional drift on the old-data distribution and improved worst-case retention guarantees. These insights lead to \textsc{PLATE} (\textbf{Pla}sticity-\textbf{T}unable \textbf{E}fficient Adapters), a continual learning method requiring no past-task data that provides explicit control over the plasticity-retention trade-off. PLATE parameterizes each layer with a structured low-rank update $ΔW = B A Q^\top$, where $B$ and $Q$ are computed once from pretrained weights and kept frozen, and only $A$ is trained on the new task. The code is available at https://github.com/SalesforceAIResearch/PLATE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。