arXiv:2506.16330cs.CVcs.AI2025-06TPAMI被引 38

提出新方法提升少样本学习在双重噪声下的可靠性。

Reliable Few-shot Learning under Dual Noises

  • 用对比聚合模块计算支持样本权重,增强抗噪能力。
  • 在多个数据集上准确率提升,最高达1.8%以上。
  • 适合存在标注噪声的少样本实际应用场景。

近期预训练模型的发展推动了基于任务适配的少样本学习(FSL),目标是从少量标注的支持样本中捕捉特定任务知识。然而,现有方法在开放世界中仍可能因支持与查询样本中存在的分布内(ID)和分布外(OOD)噪声而失效。由于支持样本有限,双重噪声在任务适配过程中会被放大,导致模型对查询样本产生不可靠预测。本文提出DETA++,通过对比相关性聚合(CoRA)模块为支持样本计算图像与区域权重,设计清洁原型损失与噪声熵最大化损失,实现抗噪的任务适配。同时,引入记忆库存储并优化每类内部的清洁区域,结合局部最近中心分类器(LocalNCC)提升查询预测鲁棒性。此外,采用类内区域交换(IntraSwap)策略修正分布内类别原型,增强对双重噪声的鲁棒性。大量实验验证了DETA++的有效性与灵活性。

原文摘要 · Abstract (English)

Recent advances in model pre-training give rise to task adaptation-based few-shot learning (FSL), where the goal is to adapt a pre-trained task-agnostic model for capturing task-specific knowledge with a few-labeled support samples of the target task.Nevertheless, existing approaches may still fail in the open world due to the inevitable in-distribution (ID) and out-of-distribution (OOD) noise from both support and query samples of the target task. With limited support samples available, i) the adverse effect of the dual noises can be severely amplified during task adaptation, and ii) the adapted model can produce unreliable predictions on query samples in the presence of the dual noises. In this work, we propose DEnoised Task Adaptation (DETA++) for reliable FSL. DETA++ uses a Contrastive Relevance Aggregation (CoRA) module to calculate image and region weights for support samples, based on which a clean prototype loss and a noise entropy maximization loss are proposed to achieve noise-robust task adaptation. Additionally,DETA++ employs a memory bank to store and refine clean regions for each inner-task class, based on which a Local Nearest Centroid Classifier (LocalNCC) is devised to yield noise-robust predictions on query samples. Moreover, DETA++ utilizes an Intra-class Region Swapping (IntraSwap) strategy to rectify ID class prototypes during task adaptation, enhancing the model's robustness to the dual noises. Extensive experiments demonstrate the effectiveness and flexibility of DETA++.

少样本学习噪声鲁棒任务适配原型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。