arXiv:2608.23782cs.LG2026-08

让提示词会根据图片自适应调整,缓解持续学习中的遗忘问题

GAP-Prompt: Gated Adaptive Prompting for Efficient Continual Learning

论文配图:GAP-Prompt: Gated Adaptive Prompting for Efficient Continual Learning
图 1 · 摘自论文原文
  • 为每张图片动态选择最佳提示注入位置
  • 在细粒度数据集上达87.29%准确率,接近联合训练上限
  • 适合需要长期学习新任务的视觉模型应用

持续学习面临灾难性遗忘挑战,即顺序任务更新会损害已有知识。尽管基于提示的方法通过冻结主干网络提供有效解决方案,但通常依赖静态的任务级提示策略,忽视了任务内部的细粒度差异。本文提出门控自适应提示(GAP-Prompt),引入实例级可适应性。该方法包含三个协同模块:(1) 实例条件门控,动态确定每张图像的最佳提示注入层;(2) 动态知识融合,实现当前与历史提示的实例感知聚合,支持跨任务知识整合;(3) 共享提示蒸馏,将基础知识锚定在早期共享层以缓解遗忘。在CIFAR-100、ImageNet-R和CUB-200基准上的广泛评估表明,GAP-Prompt持续达到领先性能。尤其在细粒度数据集CUB-200上,准确率达87.29%,接近联合训练上限(88.00%),显著优于现有方法。

原文摘要 · Abstract (English)

Continual learning faces the persistent challenge of catastrophic forgetting, where sequential task updates degrade previously acquired knowledge. While prompt-based methods integrated with pre-trained models offer a compelling solution by freezing the backbone, they often rely on static, task-level prompting strategies that overlook fine-grained intra-task diversity. In this paper, we propose Gated Adaptive Prompting (GAP-Prompt), a novel method that introduces instance-level adaptability to the prompting process. GAP-Prompt consists of three synergistic modules: (1) instance-conditioned gating, which dynamically determines optimal prompt injection layers for each individual image; (2) dynamic knowledge fusion, which performs instance-aware aggregation of current and historical prompts, enabling knowledge integration across tasks; and (3) shared prompt distillation, which anchors foundational knowledge in early shared layers to mitigate forgetting. Extensive evaluations on CIFAR-100, ImageNet-R, and CUB-200 benchmarks demonstrate that GAP-Prompt consistently achieves state-of-the-art performance. Notably, on the fine-grained CUB-200 dataset, GAP-Prompt reaches 87.29% accuracy, approaching the joint training upper bound (88.00%) and outperforming existing methods by a significant margin.

持续学习提示工程图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。