让少样本分类模型在推理时动态调整度量空间,提升对新类别的适应能力。
Episode-specific Fine-tuning for Metric-based Few-shot Learners with Optimization-based Training
- 通过构造伪支持-查询对,在推理时微调度量空间以适配当前任务。
- 在三个音频数据集上显著提升少样本分类性能,尤其对注意力模型效果更佳。
- 结合优化元学习框架,避免小样本下的过拟合,适用于各类音频识别场景。
少样本分类任务中,每个任务(称为一个episode)提供少量带标签的支持样本用于分类未标记的查询样本。现有基于度量的方法通常仅将支持样本用于计算查询与支持间的相似性,而未充分利用其潜在的微调能力。为此,本文提出一系列简单有效的推理阶段特定微调方法:旋转分块微调(RDFT)、迭代分块微调(IDFT)和增强分块微调(ADFT),通过从支持集中构建伪支持-查询对,实现对非参数模型的微调。然而,单个任务数据量极小,直接微调易引发过拟合。为此,进一步采用基于优化的元学习框架训练模型。结合任务特异性微调与优化式元训练,使模型在推理时能快速适应有限支持样本并有效防过拟合。在环境声ESC-50、语音命令V2和乐器独奏数据库Medley-solos-DB三个跨域音频数据集上验证,所提方法显著提升所有评估模型性能,尤其对注意力机制模型增益明显,且具备良好泛化能力。
原文摘要 · Abstract (English)
In few-shot classification tasks (so-called episodes), a small set of labeled support samples is provided during inference to aid the classification of unlabeled query samples. Metric-based models typically operate by computing similarities between query and support embeddings within a learned metric space, followed by nearest-neighbor classification. However, these labeled support samples are often underutilized--they are only used for similarity comparison, despite their potential to fine-tune and adapt the metric space itself to the classes in the current episode. To address this, we propose a series of simple yet effective episode-specific, during-inference fine-tuning methods for metric-based models, including Rotational Division Fine-Tuning (RDFT) and its two variants, Iterative Division Fine-Tuning (IDFT) and Augmented Division Fine-Tuning (ADFT). These methods construct pseudo support-query pairs from the given support set to enable fine-tuning even for non-parametric models. Nevertheless, the severely limited amount of data in each task poses a substantial risk of overfitting when applying such fine-tuning strategies. To mitigate this, we further propose to train the metric-based model within an optimization-based meta-learning framework. With the combined efforts of episode-specific fine-tuning and optimization-based meta-training, metric-based models are equipped with the ability to rapidly adapt to the limited support samples during inference while avoiding overfitting. We validate our approach on three audio datasets from diverse domains, namely ESC-50 (environmental sounds), Speech Commands V2 (spoken keywords), and Medley-solos-DB (musical instrument). Experimental results demonstrate that our approach consistently improves performance for all evaluated metric-based models (especially for attention-based models) and generalizes well across different audio domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。