不选提示词也能实现顶尖的在线持续学习效果。
Is Prompt Selection Necessary for Task-Free Online Continual Learning?
- 用单个提示词替代复杂选择机制,简化流程。
- 在多个基准上达到当前最佳性能,优于带提示选择的方法。
- 适合追求高效稳定的实时持续学习系统开发者。
任务无关的在线持续学习近年成为应对动态现实环境的可行范式,数据以非平稳流形式持续到达且无明确任务边界,仅能观测一次。现有方法多采用提示选择策略,从池中根据输入信号动态选取提示,但该策略常选错提示,导致结果不佳,即使额外训练关键参数也难改善。针对此问题,我们提出Simple yet effective SinglePrompt,无需提示选择,专注分类器优化:(i) 在每个自注意力块中注入单一提示;(ii) 采用余弦相似度设计输出逻辑,缓解分类器权重固有遗忘问题;(iii) 对当前小批量未暴露类别掩码其输出。该简单设计在多个在线持续学习基准上实现领先性能。代码已开源:https://github.com/efficient-learning-lab/SinglePrompt。
原文摘要 · Abstract (English)
Task-free online continual learning has recently emerged as a realistic paradigm for addressing continual learning in dynamic, real-world environments, where data arrive in a non-stationary stream without clear task boundaries and can only be observed once. To consider such challenging scenarios, many recent approaches have employed prompt selection, an adaptive strategy that selects prompts from a pool based on input signals. However, we observe that such selection strategies often fail to select appropriate prompts, yielding suboptimal results despite additional training of key parameters. Motivated by this observation, we propose a simple yet effective SinglePrompt that eliminates the need for prompt selection and focuses on classifier optimization. Specifically, we simply (i) inject a single prompt into each self-attention block, (ii) employ a cosine similarity-based logit design to alleviate the forgetting effect inherent in the classifier weights, and (iii) mask logits for unexposed classes in the current minibatch. With this simple task-free design, our framework achieves state-of-the-art performance across various online continual learning benchmarks. Source code is available at https://github.com/efficient-learning-lab/SinglePrompt.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。