arXiv:2503.04869cs.CLcs.AI2025-03中稿 · SDM 2024被引 7

用内部标签分布增强双kNN,提升文本分类准确率

Label Distribution Learning-Enhanced Dual-KNN for Text Classification

  • 设计双kNN框架,利用模型生成的标签分布增强邻居检索
  • 引入标签分布学习模块,降低噪声数据导致的误判风险
  • 适合处理标注错误或标签相似的数据集,提升分类鲁棒性

现有文本分类方法常依赖外部信息(如标签描述、知识库)提升性能,但对训练过程中自动生成的内部信息(如文本嵌入、预测标签概率分布)利用不足。本文提出一种双k近邻(D$k$NN)框架,包含两个kNN模块,从训练集中检索若干邻居并增强标签分布。传统kNN在噪声数据或标签相似数据中易受干扰,导致误判。为此,本文引入标签分布学习模块,学习标签间相似性,生成更优标签分布,帮助模型更有效区分文本,缓解过拟合,提升推理时kNN模块检索邻居的质量。在多个基准数据集上的实验验证了该方法的有效性。

原文摘要 · Abstract (English)

Many text classification methods usually introduce external information (e.g., label descriptions and knowledge bases) to improve the classification performance. Compared to external information, some internal information generated by the model itself during training, like text embeddings and predicted label probability distributions, are exploited poorly when predicting the outcomes of some texts. In this paper, we focus on leveraging this internal information, proposing a dual $k$ nearest neighbor (D$k$NN) framework with two $k$NN modules, to retrieve several neighbors from the training set and augment the distribution of labels. For the $k$NN module, it is easily confused and may cause incorrect predictions when retrieving some nearest neighbors from noisy datasets (datasets with labeling errors) or similar datasets (datasets with similar labels). To address this issue, we also introduce a label distribution learning module that can learn label similarity, and generate a better label distribution to help models distinguish texts more effectively. This module eases model overfitting and improves final classification performance, hence enhancing the quality of the retrieved neighbors by $k$NN modules during inference. Extensive experiments on the benchmark datasets verify the effectiveness of our method.

文本分类kNN标签分布深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。