arXiv:2510.11160cs.CLcs.AI2025-10

针对多标签文本分类,提出自适应阈值方法提升准确率

One Size Does Not Fit All: Exploring Variable Thresholds for Distance-Based Multi-Label Text Classification

  • 为每个标签定制相似度阈值,而非统一设定
  • 相比固定阈值提升46%,少量标注数据下仍有效
  • 适用于需快速扩展标签的场景,如信息检索

基于距离的无监督文本分类利用标签与文本间的语义相似度判断标签相关性,具有推理速度快、标签集可扩展等优势。在多标签分类中,需设定阈值判断文本是否与标签相似,相似度通常由先进句向量模型生成的密集嵌入空间决定。由于一个文本可关联多个真实标签,该问题比单标签或二分类更复杂。本文通过在多样化的多标签文本分类(MLTC)数据集上实验,验证了不同模型、数据集及标签集间语义关系存在显著差异。为此,提出基于验证集优化的标签专用阈值方法,平均性能较归一化0.5阈值提升46%,较以往统一阈值方法平均提升14%。该方法在标注样本有限时亦表现良好。

原文摘要 · Abstract (English)

Distance-based unsupervised text classification is a method within text classification that leverages the semantic similarity between a label and a text to determine label relevance. This method provides numerous benefits, including fast inference and adaptability to expanding label sets, as opposed to zero-shot, few-shot, and fine-tuned neural networks that require re-training in such cases. In multi-label distance-based classification and information retrieval algorithms, thresholds are required to determine whether a text instance is "similar" to a label or query. Similarity between a text and label is determined in a dense embedding space, usually generated by state-of-the-art sentence encoders. Multi-label classification complicates matters, as a text instance can have multiple true labels, unlike in multi-class or binary classification, where each instance is assigned only one label. We expand upon previous literature on this underexplored topic by thoroughly examining and evaluating the ability of sentence encoders to perform distance-based classification. First, we perform an exploratory study to verify whether the semantic relationships between texts and labels vary across models, datasets, and label sets by conducting experiments on a diverse collection of realistic multi-label text classification (MLTC) datasets. We find that similarity distributions show statistically significant differences across models, datasets and even label sets. We propose a novel method for optimizing label-specific thresholds using a validation set. Our label-specific thresholding method achieves an average improvement of 46% over normalized 0.5 thresholding and outperforms uniform thresholding approaches from previous work by an average of 14%. Additionally, the method demonstrates strong performance even with limited labeled examples.

多标签分类阈值优化无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。