arXiv:2503.07396cs.CVcs.AI2025-03

受大脑学习机制启发,提升少样本图像分类的泛化能力

Brain Inspired Adaptive Memory Dual-Net for Few-Shot Image Classification

  • 构建海马-新皮层双网络,模拟人类快速学习与记忆巩固
  • 在多个基准数据集上达到当前最佳性能,显著提升少样本分类准确率
  • 适合对小样本学习、类间差异大的场景感兴趣的研究者

少样本图像分类因广泛的实际应用而成为研究热点,但单图像级标注引发的监督崩溃问题仍是主要挑战。现有方法试图通过定位和对齐相关局部特征来解决,然而真实图像中类内差异大,在少样本条件下难以准确定位语义相关区域。受人类互补学习系统启发——该系统能从有限样本中快速捕捉并整合语义特征,我们提出通用性优化的系统固化自适应记忆双网(SCAM-Net)。该方法通过自适应记忆模块模拟互补学习系统的系统固化过程,有效解决了少样本场景下有意义特征识别困难的问题。具体而言,构建海马-新皮层双网络,用于固化每类的结构化表示;该表示在新皮层长期记忆中存储并依据泛化优化原则自适应调节。大量实验表明,所提模型在多个基准数据集上达到领先性能。

原文摘要 · Abstract (English)

Few-shot image classification has become a popular research topic for its wide application in real-world scenarios, however the problem of supervision collapse induced by single image-level annotation remains a major challenge. Existing methods aim to tackle this problem by locating and aligning relevant local features. However, the high intra-class variability in real-world images poses significant challenges in locating semantically relevant local regions under few-shot settings. Drawing inspiration from the human's complementary learning system, which excels at rapidly capturing and integrating semantic features from limited examples, we propose the generalization-optimized Systems Consolidation Adaptive Memory Dual-Network, SCAM-Net. This approach simulates the systems consolidation of complementary learning system with an adaptive memory module, which successfully addresses the difficulty of identifying meaningful features in few-shot scenarios. Specifically, we construct a Hippocampus-Neocortex dual-network that consolidates structured representation of each category, the structured representation is then stored and adaptively regulated following the generalization optimization principle in a long-term memory inside Neocortex. Extensive experiments on benchmark datasets show that the proposed model has achieved state-of-the-art performance.

少样本学习双网络自适应记忆图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。