arXiv:2601.08493cs.CVcs.AI2026-01被引 4

通过融合先验知识提升小样本增量学习性能,缓解遗忘与过拟合。

PKI: Prior Knowledge-Infused Neural Network for Few-Shot Class-Incremental Learning

  • 用多投影器级联结构整合历史知识,动态适应新类别。
  • 在三个基准上超越现有方法,旧类识别准确率提升显著。
  • 适合资源受限场景,提供轻量化变体平衡效率与效果。

小样本增量学习(FSCIL)旨在用少量新类别样本持续更新模型,面临灾难性遗忘和对新类过拟合两大挑战。现有方法通常冻结网络更多部分,并在增量会话中微调其余组件,辅以额外记忆。此类方法强调保留先验知识以维持旧类别识别能力,从而缓解遗忘;同时限制可调参数数量有助于克服过拟合。受此启发,本文提出先验知识注入神经网络(PKI),由主干网络、投影器集合、分类器和额外记忆组成。每个增量会话中新增一个投影器并加入集合,随后联合微调新投影器与分类器,其余组件保持冻结,以有效利用丰富先验知识。通过级联投影器,PKI融合此前会话积累的知识,灵活学习新知识,兼顾旧类识别与新类学习。为进一步降低资源开销,设计两种变体(PKIV-1 和 PKIV-2),在投影器数量与性能间权衡。在三个主流基准上的大量实验表明,该方法优于当前最先进方法。

原文摘要 · Abstract (English)

Few-shot class-incremental learning (FSCIL) aims to continually adapt a model on a limited number of new-class examples, facing two well-known challenges: catastrophic forgetting and overfitting to new classes. Existing methods tend to freeze more parts of network components and finetune others with an extra memory during incremental sessions. These methods emphasize preserving prior knowledge to ensure proficiency in recognizing old classes, thereby mitigating catastrophic forgetting. Meanwhile, constraining fewer parameters can help in overcoming overfitting with the assistance of prior knowledge. Following previous methods, we retain more prior knowledge and propose a prior knowledge-infused neural network (PKI) to facilitate FSCIL. PKI consists of a backbone, an ensemble of projectors, a classifier, and an extra memory. In each incremental session, we build a new projector and add it to the ensemble. Subsequently, we finetune the new projector and the classifier jointly with other frozen network components, ensuring the rich prior knowledge is utilized effectively. By cascading projectors, PKI integrates prior knowledge accumulated from previous sessions and learns new knowledge flexibly, which helps to recognize old classes and efficiently learn new classes. Further, to reduce the resource consumption associated with keeping many projectors, we design two variants of the prior knowledge-infused neural network (PKIV-1 and PKIV-2) to trade off a balance between resource consumption and performance by reducing the number of projectors. Extensive experiments on three popular benchmarks demonstrate that our approach outperforms state-of-the-art methods.

增量学习小样本知识融合神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。