arXiv:2507.09183cs.CV2025-07ICCV被引 8

解决少样本增量学习中提示池性能下降问题,提出空间维度新方法

Revisiting Pool-based Prompt Learning for Few-shot Class-incremental Learning

  • 将提示池从令牌维度转向空间维度,结合局部与全局特征生成提示
  • 在多个基准上达到当前最优,显著提升基础知识保留与新类学习能力
  • 适合关注少样本增量学习、提示工程与模型泛化性的研究者

少样本增量学习(FSCIL)在真实场景中面临数据稀缺与持续学习的双重挑战。尽管池化提示方法在传统增量学习中表现良好,其在FSCIL中的效果尚未被探索。本文首次系统研究现有提示池方法在FSCIL任务中的表现,发现增量阶段出现意外性能下降。深入分析表明,根源在于令牌维度饱和:有限数据下过多提示争夺任务相关信息,导致模型过拟合。基于此,我们提出LGSP-Prompt(局部-全局空间提示),创新性地将池化提示学习从令牌维度迁移至空间维度。该方法通过融合局部空间特征与全局频域表示,生成能突出输入图像关键模式的空间提示。构建两个空间提示池,支持动态选择以兼顾已学知识与新任务学习。大量实验表明,本方法在多个FSCIL基准上达到领先性能,尤其在基础知识保持与增量学习方面优势明显。代码已开源:https://github.com/Jywsuperman/LGSP。

原文摘要 · Abstract (English)

Few-Shot Class-Incremental Learning (FSCIL) faces dual challenges of data scarcity and incremental learning in real-world scenarios. While pool-based prompting methods have demonstrated success in traditional incremental learning, their effectiveness in FSCIL settings remains unexplored. This paper presents the first study of current prompt pool methods in FSCIL tasks, revealing an unanticipated performance degradation in incremental sessions. Through comprehensive analysis, we identify that this phenomenon stems from token-dimension saturation: with limited data, excessive prompts compete for task-relevant information, leading to model overfitting. Based on this finding, we propose LGSP-Prompt (Local-Global Spatial Prompting), which innovatively shifts pool-based prompt learning from the token dimension to the spatial dimension. LGSP-Prompt generates spatial prompts by synergistically combining local spatial features and global frequency-domain representations to highlight key patterns in input images. We construct two spatial prompt pools enabling dynamic prompt selection to maintain acquired knowledge while effectively learning novel sessions. Extensive experiments demonstrate that our approach achieves state-of-the-art performance across multiple FSCIL benchmarks, showing significant advantages in both base knowledge preservation and incremental learning. Our implementation is available at https://github.com/Jywsuperman/LGSP.

少样本学习增量学习提示工程空间提示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。