arXiv:2607.01297eess.AScs.LG2026-07中稿 · publication in IEE…被引 2

小样本音频分类中识别已知类并拒绝未知类,提升模型泛化能力。

Few-Shot Open-Set Audio Classification Using Attention Information-Fused Prototypes

  • 融合支持与查询样本的注意力信息生成原型,增强判别性。
  • 在三个公开数据集上准确率与AUROC均优于现有方法,统计显著。
  • 计算复杂度低,适合资源受限场景,适用于小样本开放集任务。

现有音频分类方法通常假设每个测试样本属于训练过的类别,无法识别未见类别而将其误判为已知类。本文提出少样本开放集音频分类(FOAC)方法,可在仅用少量支持样本更新模型后,正确识别已知类查询样本,并有效拒绝未见类样本。模型由编码器和分类器组成:编码器采用ResNet骨干网络提取嵌入表示;分类器包含少样本类和开放集类的原型生成器。少样本类原型通过融合支持与查询嵌入的类别判别信息生成,对支持样本中代表性部分赋予更高权重。开放集类仅生成一个原型。编码器先在基础类丰富数据上监督训练,再通过联合损失生成基础类原型;分类器采用元训练方式,仅用少量少样本类数据进行训练。在LS-100、NSynth-100和FSC-89三个公开数据集上评估,结果表明本方法在AUROC和准确率上均优于先前方法,且多数对比具有统计显著性。同时,计算复杂度低于多数已有方法。代码已开源:https://github.com/Jessytan/FOAC-AIFP。

原文摘要 · Abstract (English)

Most existing audio classification methods suppose that each query (testing) sample belongs to a class of support (training) samples, and misrecognize samples of unseen classes as seen classes (cannot reject samples of unseen classes). In this study, we propose a method for Few-shot Open-set Audio Classification (FOAC), which can recognize query samples of seen classes after updating the model using a few support samples, and meanwhile reject query samples from unseen classes. We design a model consisting of an encoder and a classifier. The encoder is the backbone of a ResNet used for extracting embeddings. The classifier consists of prototype generators of few-shot classes and open-set classes. Prototypes of few-shot classes are obtained by fusing the class-discriminative information of support and query embeddings and by assigning larger weighting coefficient to representative part of the support embeddings. One prototype is generated for open-set classes using the proposed prototype generator. The encoder is trained with abundant samples of base classes in supervised manner, and then the prototypes of base classes are generated under the supervision of a joint loss. The classifier is trained using a few samples of few-shot classes in a meta-training way. Three public datasets (LS-100, NSynth-100, and FSC-89) are used to assess the performance of our method. Experiments show that our method has advantage over prior methods in AUROC and accuracy. This advantage has statistical significance for most prior methods. Our method has lower computational complexity than most prior methods. The code is at https://github.com/Jessytan/FOAC-AIFP.

音频分类少样本学习开放集识别原型网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。