arXiv:2505.09486cs.LGcs.AI2025-05中稿 · 4th Conference on …被引 1

通过自适应注入线性项,提升模型持续学习时的可塑性。

Preserving Plasticity in Continual Learning with Adaptive Linearity Injection

  • 为每个神经元动态注入线性成分,基于梯度流调节激活函数。
  • 在多个基准任务上显著提升持续学习性能,如扰动MNIST和CIFAR-100。
  • 无需额外超参数或任务边界,适用于复杂场景如类增量学习与强化学习。

深度神经网络在持续学习中会逐渐丧失可塑性,即增量学习能力下降,这已成为非平稳问题设置下的关键障碍。近期研究表明,深层线性网络对可塑性损失具有较强鲁棒性。受此启发,本文提出自适应线性化(AdaLin),一种通用方法:通过为每个神经元引入可学习参数与门控机制,根据梯度流动动态注入线性成分到激活函数中。该自适应调制确保了充足的梯度信号,维持持续学习能力,且无需额外超参数或显式任务边界。在标准基准测试中,结合ReLU、Tanh、GeLU等传统激活函数,AdaLin在随机标签与扰动MNIST、随机标签与打乱CIFAR-10、类别分割的CIFAR-100上均显著提升性能。此外,其有效性在更复杂场景中得到验证,包括基于ResNet-18的类增量学习与离策略强化学习代理中的可塑性损失缓解。系统消融实验表明神经元级自适应对性能至关重要,并分析了若干可能与可塑性损失相关的网络指标。

原文摘要 · Abstract (English)

Loss of plasticity in deep neural networks is the gradual reduction in a model's capacity to incrementally learn and has been identified as a key obstacle to learning in non-stationary problem settings. Recent work has shown that deep linear networks tend to be resilient towards loss of plasticity. Motivated by this observation, we propose Adaptive Linearization (AdaLin), a general approach that dynamically adapts each neuron's activation function to mitigate plasticity loss. Unlike prior methods that rely on regularization or periodic resets, AdaLin equips every neuron with a learnable parameter and a gating mechanism that injects linearity into the activation function based on its gradient flow. This adaptive modulation ensures sufficient gradient signal and sustains continual learning without introducing additional hyperparameters or requiring explicit task boundaries. When used with conventional activation functions like ReLU, Tanh, and GeLU, we demonstrate that AdaLin can significantly improve performance on standard benchmarks, including Random Label and Permuted MNIST, Random Label and Shuffled CIFAR-10, and Class-Split CIFAR-100. Furthermore, its efficacy is shown in more complex scenarios, such as class-incremental learning on CIFAR-100 with a ResNet-18 backbone, and in mitigating plasticity loss in off-policy reinforcement learning agents. We perform a systematic set of ablations that show that neuron-level adaptation is crucial for good performance and analyze a number of metrics in the network that might be correlated to loss of plasticity.

持续学习可塑性神经网络自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。