arXiv:2411.13687cs.CL2024-11被引 2

顶级的极端多标签模型其实自带层次结构,可直接当层次文本分类用。

Your Extreme Multi-label Classifier is Secretly a Hierarchical Text Classifier for Free

  • XML模型内部自建层次结构,可直接用于层次分类任务。
  • 在极端多标签数据集上,传统层次分类模型表现显著下降。
  • 建议比较时使用F1、P@k和R-Precision多个指标更全面。

给定文本分配一组标签是许多实际应用中的分类问题,如推荐系统。该问题存在两条研究路径:层次文本分类(HTC)处理具有数百个标签且带有语义层级的标签池;极端多标签文本分类(XML)则面对多达百万级标签但无显式层级的场景。现有XML方法常在训练前或训练中构建人工层级以应对大规模标签空间。本文在两个基准数据集上对比了主流HTC与XML模型在对方任务上的表现。结果表明,具备内部层级结构的XML模型在HTC任务中表现优异;而传统HTC模型因无法处理超大规模标签集,在转移学习中表现较差。我们进一步指出,公平比较HTC与XML应采用多指标,如F1需辅以P@k和R-Precision。

原文摘要 · Abstract (English)

Assigning a set of labels to a given text is a classification problem with many real-world applications, such as recommender systems. Two separate research streams address this issue. Hierarchical Text Classification (HTC) focuses on datasets with label pools of hundreds of entries, accompanied by a semantic label hierarchy. In contrast, eXtreme Multi-Label Text Classification (XML) considers very large sets of labels with up to millions of entries but without an explicit hierarchy. In XML methods, it is common to construct an artificial hierarchy in order to deal with the large label space before or during the training process. Here, we investigate how state-of-the-art HTC models perform when trained and tested on XML datasets and vice versa using three benchmark datasets from each of the two streams. Our results demonstrate that XML models, with their internally constructed hierarchy, are very effective HTC models. HTC models, on the other hand, are not equipped to handle the sheer label set size of XML datasets and achieve poor transfer results. We further argue that for a fair comparison in HTC and XML, more than one metric like F1 should be used but complemented with P@k and R-Precision.

多标签分类层次结构迁移性能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。