arXiv:2410.20444cs.LGcs.CV2024-10NeurIPS被引 13

用离散提示增强模型持续学习能力,避免遗忘。

Vector Quantization Prompting for Continual Learning

  • 引入向量量化生成离散提示,提升任务表征抽象性。
  • 端到端优化提示选择过程,提升特征适应性。
  • 在多个基准上超越现有方法,适合长期学习场景。

持续学习需在序列化任务训练中克服灾难性遗忘问题。现有先进方法采用可学习提示(prompt)编码任务知识,通过选择合适提示引导预训练模型生成特定任务特征。然而,这些方法依赖提示身份预测进行选择,而该过程无法与任务损失联合优化,导致提示选择不优且特征适应不足。此前尝试直接从输入生成连续提示,但连续表示缺乏足够抽象性,不利于持续学习。为此,我们提出VQ-Prompt,将向量量化(Vector Quantization, VQ)引入离散提示的端到端训练,使提示选择过程可被任务损失优化,同时实现对任务知识的有效抽象。大量实验表明,VQ-Prompt在多种基准上均优于当前最先进方法,尤其在挑战性的类增量设置下表现突出。代码已开源。

原文摘要 · Abstract (English)

Continual learning requires to overcome catastrophic forgetting when training a single model on a sequence of tasks. Recent top-performing approaches are prompt-based methods that utilize a set of learnable parameters (i.e., prompts) to encode task knowledge, from which appropriate ones are selected to guide the fixed pre-trained model in generating features tailored to a certain task. However, existing methods rely on predicting prompt identities for prompt selection, where the identity prediction process cannot be optimized with task loss. This limitation leads to sub-optimal prompt selection and inadequate adaptation of pre-trained features for a specific task. Previous efforts have tried to address this by directly generating prompts from input queries instead of selecting from a set of candidates. However, these prompts are continuous, which lack sufficient abstraction for task knowledge representation, making them less effective for continual learning. To address these challenges, we propose VQ-Prompt, a prompt-based continual learning method that incorporates Vector Quantization (VQ) into end-to-end training of a set of discrete prompts. In this way, VQ-Prompt can optimize the prompt selection process with task loss and meanwhile achieve effective abstraction of task knowledge for continual learning. Extensive experiments show that VQ-Prompt outperforms state-of-the-art continual learning methods across a variety of benchmarks under the challenging class-incremental setting. The code is available at \href{https://github.com/jiaolifengmi/VQ-Prompt}{this https URL}.

持续学习提示工程向量量化特征提取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。