arXiv:2509.15785cs.CVcs.AI2025-09

提出CBPNet缓解边缘设备持续学习中的遗忘问题。

CBPNet: A Continual Backpropagation Prompt Network for Alleviating Plasticity Loss on Edge Devices

  • 通过自适应重置未充分利用参数,恢复模型学习活力。
  • 在Split CIFAR-100上提升超1%平均准确率,ImageNet-R达69.41%新高。
  • 仅增加不足0.2%主干参数量,适合资源受限场景。

为满足机器人和自动驾驶等需实时响应动态环境的应用需求,高效适用于边缘设备的持续学习方法日益受到关注。当前主流策略是使用冻结预训练模型并结合提示(prompt)以应对灾难性遗忘。然而,该方法引入了新瓶颈:塑性损失,即因主干冻结和提示参数容量有限,导致模型学习新知识的能力下降。我们指出,塑性下降源于训练过程中部分参数更新活力不足。为此,提出持续反向传播提示网络(CBPNet),一种高效且参数节省的框架,以恢复模型学习能力。创新性地引入高效CBP模块,通过自适应重置未充分利用参数来对抗塑性衰减。在边缘设备上的实验表明,该方法在多个基准上均有效。在Split CIFAR-100上,相比强基线平均准确率提升超过1%;在更具挑战性的Split ImageNet-R上达到69.41%的最新准确率。整个过程仅训练额外少于0.2%主干参数量的参数,验证了方法的有效性。

原文摘要 · Abstract (English)

To meet the demands of applications like robotics and autonomous driving that require real-time responses to dynamic environments, efficient continual learning methods suitable for edge devices have attracted increasing attention. In this transition, using frozen pretrained models with prompts has become a mainstream strategy to combat catastrophic forgetting. However, this approach introduces a new critical bottleneck: plasticity loss, where the model's ability to learn new knowledge diminishes due to the frozen backbone and the limited capacity of prompt parameters. We argue that the reduction in plasticity stems from a lack of update vitality in underutilized parameters during the training process. To this end, we propose the Continual Backpropagation Prompt Network (CBPNet), an effective and parameter efficient framework designed to restore the model's learning vitality. We innovatively integrate an Efficient CBP Block that counteracts plasticity decay by adaptively reinitializing these underutilized parameters. Experimental results on edge devices demonstrate CBPNet's effectiveness across multiple benchmarks. On Split CIFAR-100, it improves average accuracy by over 1% against a strong baseline, and on the more challenging Split ImageNet-R, it achieves a state of the art accuracy of 69.41%. This is accomplished by training additional parameters that constitute less than 0.2% of the backbone's size, validating our approach.

持续学习边缘计算提示学习模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。