arXiv:2511.12090cs.CV2025-11

通过分组共享提示提升持续学习稳定性,防止遗忘。

Teaching Prompts to Coordinate: Hierarchical Layer-Grouped Prompt Tuning for Continual Learning

  • 将模型层分组,同组共享提示并用位置编码调整。
  • 仅用一个根提示生成各组子提示,增强协同性。
  • 在4个基准上优于现有方法,有效缓解灾难性遗忘。

基于提示的持续学习方法仅微调少量可学习参数,保持预训练模型参数冻结,实现高效新任务适应并降低灾难性遗忘风险。传统方法在每层独立添加任务专属提示以局部调节特征,虽灵活但易导致某些层过度更新。由于所有历史提示合并为最终提示,可能覆盖对旧任务至关重要的特征表示。为此,我们提出一种新的分层分组提示调优方法:(i) 同组层共享近似相同提示,并通过位置编码调整,保留预训练模型内部特征关系与传播路径;(ii) 使用单一任务专属根提示生成各组子提示,使所有子提示均依赖同一根提示,增强协同性并减少独立性。在四个基准上的大量实验表明,该方法相较多个先进方法表现更优。

原文摘要 · Abstract (English)

Prompt-based continual learning methods fine-tune only a small set of additional learnable parameters while keeping the pre-trained model's parameters frozen. It enables efficient adaptation to new tasks while mitigating the risk of catastrophic forgetting. These methods typically attach one independent task-specific prompt to each layer of pre-trained models to locally modulate its features, ensuring that the layer's representation aligns with the requirements of the new task. However, although introducing learnable prompts independently at each layer provides high flexibility for adapting to new tasks, this overly flexible tuning could make certain layers susceptible to unnecessary updates. As all prompts till the current task are added together as a final prompt for all seen tasks, the model may easily overwrite feature representations essential to previous tasks, which increases the risk of catastrophic forgetting. To address this issue, we propose a novel hierarchical layer-grouped prompt tuning method for continual learning. It improves model stability in two ways: (i) Layers in the same group share roughly the same prompts, which are adjusted by position encoding. This helps preserve the intrinsic feature relationships and propagation pathways of the pre-trained model within each group. (ii) It utilizes a single task-specific root prompt to learn to generate sub-prompts for each layer group. In this way, all sub-prompts are conditioned on the same root prompt, enhancing their synergy and reducing independence. Extensive experiments across four benchmarks demonstrate that our method achieves favorable performance compared with several state-of-the-art methods.

持续学习提示调优分组机制灾难性遗忘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。