arXiv:2412.10110cs.CLcs.AI2024-12

用标签模板+对比学习,让少样本文本分类更准

Label-template based Few-Shot Text Classification with Contrastive Learning

  • 将标签转为模板嵌入句子,利用标签语义指导表征学习
  • 通过对比学习增强支持集与查询集的区分能力,提升分类效果
  • 适合标签信息丰富的少样本分类任务,尤其对噪声敏感场景有效

作为学习如何学习的算法框架,元学习为少样本文本分类提供了有前景的解决方案。然而,现有研究大多忽视了类别标签的作用。传统基于原型网络的元学习框架高度依赖类间差异,易受噪声影响。为此,本文提出一种简单有效的少样本文本分类框架:将类别标签转化为模板并嵌入输入句子,充分挖掘标签的潜在价值,借助标签传递的语义信息引导预训练模型生成更具判别性的文本表示。在标签语义持续作用下,采用监督对比学习建模支持样本与查询样本之间的交互信息。同时,以注意力机制替代平均聚合,突出关键语义。在四个典型数据集上验证方案有效性,实验结果表明,该方法显著提升性能,在少样本文本分类任务中优于现有最先进模型。

原文摘要 · Abstract (English)

As an algorithmic framework for learning to learn, meta-learning provides a promising solution for few-shot text classification. However, most existing research fail to give enough attention to class labels. Traditional basic framework building meta-learner based on prototype networks heavily relies on inter-class variance, and it is easily influenced by noise. To address these limitations, we proposes a simple and effective few-shot text classification framework. In particular, the corresponding label templates are embed into input sentences to fully utilize the potential value of class labels, guiding the pre-trained model to generate more discriminative text representations through the semantic information conveyed by labels. With the continuous influence of label semantics, supervised contrastive learning is utilized to model the interaction information between support samples and query samples. Furthermore, the averaging mechanism is replaced with an attention mechanism to highlight vital semantic information. To verify the proposed scheme, four typical datasets are employed to assess the performance of different methods. Experimental results demonstrate that our method achieves substantial performance enhancements and outperforms existing state-of-the-art models on few-shot text classification tasks.

少样本学习对比学习文本分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。