用预测式提示解决增量学习中旧类遗忘问题
PrePrompt: Predictive prompting for class incremental learning
- 先预测任务专属提示,再进行分类,摆脱依赖特征匹配的旧方法
- 在多个基准上优于当前最优提示方法,尤其在旧类上表现更稳
- 适合研究持续学习与提示工程的开发者
基于预训练模型的类别增量学习(CIL)为开放世界持续学习提供了有前景的方向。现有方法通常依赖相关性策略,将图像的分类特征作为查询,检索最相关的关键提示,并选择对应值提示用于训练。然而,这类方法存在根本局限:仅用少量可训练提示拟合所有任务的完整特征空间极为困难。本文提出预测式提示(PrePrompt),一种新型CIL框架,通过利用预训练模型固有的分类能力来预测任务特定提示,绕过相关性策略的限制。具体而言,PrePrompt将CIL分解为两阶段预测框架:任务特定提示预测,随后是标签预测。尽管该框架理论上具有优势,但可能因缺乏历史数据而偏向新类别。为此,PrePrompt引入特征迁移机制,动态平衡稳定性与可塑性。在多个基准上的实验表明,PrePrompt显著优于当前最先进的基于提示的CIL方法。代码已开源。
原文摘要 · Abstract (English)
Class Incremental Learning (CIL) based on pre-trained models offers a promising direction for open-world continual learning. Existing methods typically rely on correlation-based strategies, where an image's classification feature is used as a query to retrieve the most related key prompts and select the corresponding value prompts for training. However, these approaches face an inherent limitation: fitting the entire feature space of all tasks with only a few trainable prompts is fundamentally challenging. We propose Predictive Prompting (PrePrompt), a novel CIL framework that circumvents correlation-based limitations by leveraging pre-trained models' natural classification ability to predict task-specific prompts. Specifically, PrePrompt decomposes CIL into a two-stage prediction framework: task-specific prompt prediction followed by label prediction. While theoretically appealing, this framework risks bias toward recent classes due to missing historical data for older classifier calibration. PrePrompt then mitigates this by incorporating feature translation, dynamically balancing stability and plasticity. Experiments across multiple benchmarks demonstrate PrePrompt's superiority over state-of-the-art prompt-based CIL methods. Code available at \href{github.com/libo-huang/preprompt}{github.com/libo-huang/preprompt}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。