用共享提示直接改写分类令牌,实现高效无回放增量学习
Achieving More with Less: Additive Prompt Tuning for Rehearsal-Free Class-Incremental Learning
- 共享一组提示,通过加法修改分类令牌注意力,无需拼接
- 推理成本和可训练参数大幅减少,性能优于现有提示方法
- 适合追求高效微调的开发者,尤其适用于资源受限场景
类别增量学习(CIL)使模型在不遗忘旧知识的前提下逐步学习新类别。近期研究多采用可学习提示池的参数高效微调框架,但存在提示查询开销大、输入序列过长的问题。本文提出一种新方法:训练单组共享提示,不将提示拼接到输入,而是直接将其加到分类令牌(CLS token)的注意力计算中。该轻量设计显著降低推理成本与可训练参数数量,且无需为不同任务调整提示长度。在多个CIL基准上的实验证明其有效性,展现了建立新提示型CIL范式潜力。此外,在非CIL通用识别任务上也表现优异,表明其具备成为通用参数高效微调方案的前景。
原文摘要 · Abstract (English)
Class-incremental learning (CIL) enables models to learn new classes progressively while preserving knowledge of previously learned ones. Recent advances in this field have shifted towards parameter-efficient fine-tuning techniques, with many approaches building upon the framework that maintains a pool of learnable prompts. Although effective, these methods introduce substantial computational overhead, primarily due to prompt pool querying and increased input sequence lengths from prompt concatenation. In this work, we present a novel prompt-based approach that addresses this limitation. Our method trains a single set of shared prompts across all tasks and, rather than concatenating prompts to the input, directly modifies the CLS token's attention computation by adding the prompts to it. This simple and lightweight design not only significantly reduces computational complexity-both in terms of inference costs and the number of trainable parameters-but also eliminates the need to optimize prompt lengths for different downstream tasks, offering a more efficient yet powerful solution for rehearsal-free class-incremental learning. Extensive experiments across a diverse range of CIL benchmarks demonstrate the effectiveness of our approach, highlighting its potential to establish a new prompt-based CIL paradigm. Furthermore, experiments on general recognition benchmarks beyond the CIL setting also show strong performance, positioning our method as a promising candidate for a general parameter-efficient fine-tuning approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。