arXiv:2507.20834cs.CV2025-07ICCV被引 3

CLIP少样本评估存在偏差,新方法通过去学习实现真正归纳泛化。

Rethinking Few Shot CLIP Benchmarks: A Critical Analysis in the Inductive Setting

  • 用去学习技术构建真正的归纳设置基准
  • 13种基线方法平均性能下降55%
  • 提出新方法在5880次实验中持续领先

CLIP在少样本场景下具备可迁移的分类能力,已有多种方法提升其性能。然而,这些方法均在标准少样本数据集上评估,而这些数据集大多已被CLIP见过,导致评估结果偏向部分传递性。为此,本文提出一种基于去学习技术的流水线,以获得真正的归纳基准。在新归纳设置下,13个基线方法平均性能下降55%。通过正例基线验证了去学习的有效性,并提出一种改进的少样本分类方法,在涵盖5880次实验的综合分析中(包括不同数据集、少样本数量、去学习设置和随机种子),持续优于13种近期基线方法。本文揭示了基于CLIP的少样本分类评估问题,提供解决方案、新基准和更优方法。

原文摘要 · Abstract (English)

CLIP is a foundational model with transferable classification performance in the few-shot setting. Several methods have shown improved performance of CLIP using few-shot examples. However, so far, all these techniques have been benchmarked using standard few-shot datasets. We argue that this mode of evaluation does not provide a true indication of the inductive generalization ability using few-shot examples. As most datasets have been seen by the CLIP model, the resultant setting can be termed as partially transductive. To solve this, we propose a pipeline that uses an unlearning technique to obtain true inductive baselines. In this new inductive setting, the methods show a significant drop in performance (-55% on average among 13 baselines with multiple datasets). We validate the unlearning technique using oracle baselines. An improved few-shot classification technique is proposed that consistently obtains state-of-the-art performance over 13 other recent baseline methods on a comprehensive analysis with 5880 experiments - varying the datasets, differing number of few-shot examples, unlearning setting, and with different seeds. Thus, we identify the issue with the evaluation of CLIP-based few-shot classification, provide a solution using unlearning, propose new benchmarks, and provide an improved method.

少样本学习CLIP归纳泛化去学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。