arXiv:2412.16739cs.CV2024-12CVPR被引 4

用可学习的优化器提升少样本分类性能,避免人工调参

UNEM: UNrolled Generalized EM for Transductive Few-Shot Learning

  • 将EM算法展开为神经网络,自动学习最优超参数
  • 在视觉和视觉-语言模型上分别提升10%和7.5%准确率
  • 适合需要高效调参的少样本学习场景

横贯式少样本学习近年来在计算机视觉领域受到广泛关注。然而,现有方法引入关键超参数,用于控制测试批次的预测统计特性(如类别平衡程度),显著影响性能。这些超参数通常需在验证数据上通过经验网格搜索确定,且其配置随目标数据集和预训练模型变化大,导致搜索过程既不最优也计算成本高昂。本文提出在少样本学习中采用展开范式(即“学会优化”),以高效、有效地学习一组优化后的超参数。具体地,我们将广义期望最大化(EM)优化器展开为神经网络结构,将每一步迭代映射为一层,并在验证数据上学习关键超参数。该方法适用于多种统计特征分布及预训练范式,涵盖最新的视觉-语言基础模型与传统纯视觉分类器。实验覆盖广泛细粒度图像分类任务,结果表明所提展开式EM算法相比迭代变体有显著提升,视觉模型上最高提升10%,视觉-语言模型上最高提升7.5%。

原文摘要 · Abstract (English)

Transductive few-shot learning has recently triggered wide attention in computer vision. Yet, current methods introduce key hyper-parameters, which control the prediction statistics of the test batches, such as the level of class balance, affecting performances significantly. Such hyper-parameters are empirically grid-searched over validation data, and their configurations may vary substantially with the target dataset and pre-training model, making such empirical searches both sub-optimal and computationally intractable. In this work, we advocate and introduce the unrolling paradigm, also referred to as "learning to optimize", in the context of few-shot learning, thereby learning efficiently and effectively a set of optimized hyper-parameters. Specifically, we unroll a generalization of the ubiquitous Expectation-Maximization (EM) optimizer into a neural network architecture, mapping each of its iterates to a layer and learning a set of key hyper-parameters over validation data. Our unrolling approach covers various statistical feature distributions and pre-training paradigms, including recent foundational vision-language models and standard vision-only classifiers. We report comprehensive experiments, which cover a breadth of fine-grained downstream image classification tasks, showing significant gains brought by the proposed unrolled EM algorithm over iterative variants. The achieved improvements reach up to 10% and 7.5% on vision-only and vision-language benchmarks, respectively.

少样本学习优化器设计视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。