arXiv:2507.00401cs.CVcs.LG2025-07

不微调主干网络,用新方法实现跨域少样本分类的高效迁移。

Few-shot Classification as Multi-instance Verification: Effective Backbone-agnostic Transfer across Domains

  • 将少样本分类视为多实例验证任务,设计无需依赖主干网络的新分类头。
  • 在多个数据集上性能接近顶尖微调方法,但适应成本大幅降低。
  • 适合无法微调模型的工业场景,尤其适用于现成预训练模型部署。

我们研究在无法微调主干网络(即特征提取器)的约束下进行跨域少样本学习,这一场景在实际应用中日益普遍。面对冻结的、'黑箱'主干网络产生的低质量静态嵌入,我们将少样本分类建模为一系列多实例验证(MIV)任务。受此启发,提出一种新型少样本域适应方法——MIV-head,其作为与主干无关的分类头,计算高效。该头在目标域少样本数据上训练后,可在同一域测试数据上取得优异表现,且无需在元测试阶段微调主干。在扩展的Meta-dataset基准上,使用ImageNet1K预训练的卷积神经网络和视觉变压器主干,在多种设置下实验表明,MIV-head在准确率上媲美当前最优的适配器(部分微调)方法,但适应开销显著更低。对比发现,传统分类头方法准确率明显落后。消融实验证明了核心组件的有效性。代码已开源:https://github.com/xxweka/MIV-head。

原文摘要 · Abstract (English)

We investigate cross-domain few-shot learning under the constraint that fine-tuning of backbones (i.e., feature extractors) is impossible or infeasible -- a scenario that is increasingly common in practical use cases. Handling the low-quality and static embeddings produced by frozen, "black-box" backbones leads to a problem representation of few-shot classification as a series of multiple instance verification (MIV) tasks. Inspired by this representation, we introduce a novel approach to few-shot domain adaptation, named the "MIV-head", akin to a classification head that is agnostic to any pretrained backbone and computationally efficient. The core components designed for the MIV-head, when trained on few-shot data from a target domain, collectively yield strong performance on test data from that domain. Importantly, it does so without fine-tuning the backbone, and within the "meta-testing" phase. Experimenting under various settings and on an extension of the Meta-dataset benchmark for cross-domain few-shot image classification, using representative off-the-shelf convolutional neural network and vision transformer backbones pretrained on ImageNet1K, we show that the MIV-head achieves highly competitive accuracy when compared to state-of-the-art "adapter" (or partially fine-tuning) methods applied to the same backbones, while incurring substantially lower adaptation cost. We also find well-known "classification head" approaches lag far behind in terms of accuracy. Ablation study empirically justifies the core components of our approach. We share our code at https://github.com/xxweka/MIV-head.

少样本学习跨域迁移无微调分类头

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。