arXiv:2412.10900cs.LGcs.CV2024-12中稿 · AAAI被引 1

提出无需依赖输入的提示增强方法,缓解增量学习中的遗忘问题。

PEARL: Input-Agnostic Prompt Enhancement with Negative Feedback Regulation for Class-Incremental Learning

  • 设计全局无输入依赖提示,降低对数据分布的敏感性。
  • 引入负反馈调节的自适应动量更新,提升参数稳定性。
  • 在6个基准上达到领先性能,适合持续学习研究者使用。

类别增量学习(CIL)旨在不遗忘旧类别的情况下持续引入新类别,以适应不断变化的数据分布。当前研究聚焦于利用预训练模型(PTM)丰富的语义信息。提示学习因其能调整数据分布以更好对齐预训练知识,被应用于CIL。本文从提示学习角度批判性分析现有方法对输入信息的高度依赖问题。为此,提出一种基于PTM的新型CIL方法——输入无关提示增强与负反馈调节(PEARL)。PEARL采用输入无关的全局提示,结合自适应动量更新策略,减少模型对数据分布的依赖,有效缓解灾难性遗忘。在负反馈调节下,该动量更新解决固定权重更新带来的参数敏感性问题,并通过挖掘不同任务间的相关性,持续优化新任务的提示。在六个基准上的实验表明,本方法表现优异,代码已公开于https://github.com/qinyongchun/PEARL。

原文摘要 · Abstract (English)

Class-incremental learning (CIL) aims to continuously introduce novel categories into a classification system without forgetting previously learned ones, thus adapting to evolving data distributions. Researchers are currently focusing on leveraging the rich semantic information of pre-trained models (PTMs) in CIL tasks. Prompt learning has been adopted in CIL for its ability to adjust data distribution to better align with pre-trained knowledge. This paper critically examines the limitations of existing methods from the perspective of prompt learning, which heavily rely on input information. To address this issue, we propose a novel PTM-based CIL method called Input-Agnostic Prompt Enhancement with Negative Feedback Regulation (PEARL). In PEARL, we implement an input-agnostic global prompt coupled with an adaptive momentum update strategy to reduce the model's dependency on data distribution, thereby effectively mitigating catastrophic forgetting. Guided by negative feedback regulation, this adaptive momentum update addresses the parameter sensitivity inherent in fixed-weight momentum updates. Furthermore, it fosters the continuous enhancement of the prompt for new tasks by harnessing correlations between different tasks in CIL. Experiments on six benchmarks demonstrate that our method achieves state-of-the-art performance. The code is available at: https://github.com/qinyongchun/PEARL.

增量学习提示学习预训练模型负反馈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。