arXiv:2409.07989cs.CVcs.AI2024-09被引 42

通过多尺度嵌入与可学习权重提升少样本图像分类性能

Enhancing Few-Shot Image Classification through Learnable Multi-Scale Embedding and Attention Mechanisms

  • 设计多阶段嵌入网络,融合浅层与深层特征
  • 在MiniImageNet上5类1样本任务达74.6%准确率
  • 适合需要高泛化能力的少样本学习研究者

少样本分类旨在用极少样本训练分类器并保持良好性能。传统基于度量的方法通常仅依赖查询特征与支持特征间的单一距离值,忽略浅层特征贡献。为此,本文提出一种新方法:采用多输出嵌入网络,将样本映射到不同特征空间,在多个阶段提取特征向量,以捕捉全局与抽象特征。结合自注意力机制,对各阶段特征进行优化,生成更鲁棒的表示。同时,为各阶段分配可学习权重,显著提升性能。在MiniImageNet和FC100数据集上,分别在5类1样本与5类5样本场景下进行评估,并在八个基准数据集间进行跨域测试,均取得优于当前先进方法的结果。

原文摘要 · Abstract (English)

In the context of few-shot classification, the goal is to train a classifier using a limited number of samples while maintaining satisfactory performance. However, traditional metric-based methods exhibit certain limitations in achieving this objective. These methods typically rely on a single distance value between the query feature and support feature, thereby overlooking the contribution of shallow features. To overcome this challenge, we propose a novel approach in this paper. Our approach involves utilizing a multi-output embedding network that maps samples into distinct feature spaces. The proposed method extracts feature vectors at different stages, enabling the model to capture both global and abstract features. By utilizing these diverse feature spaces, our model enhances its performance. Moreover, employing a self-attention mechanism improves the refinement of features at each stage, leading to even more robust representations and improved overall performance. Furthermore, assigning learnable weights to each stage significantly improved performance and results. We conducted comprehensive evaluations on the MiniImageNet and FC100 datasets, specifically in the 5-way 1-shot and 5-way 5-shot scenarios. Additionally, we performed cross-domain tasks across eight benchmark datasets, achieving high accuracy in the testing domains. These evaluations demonstrate the efficacy of our proposed method in comparison to state-of-the-art approaches. https://github.com/FatemehAskari/MSENet

少样本学习多尺度特征自注意力嵌入网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。