用大模型优化分类体系,让文本分类更准。
Hierarchical Text Classification with LLM-Refined Taxonomies
- 用大模型重命名、合并、拆分标签,重构完整分类结构
- 在三个数据集上比人工设计的分类体系最高提升2.9个百分点的准确率
- 优化后的分类体系更贴合模型的学习习惯,适合追求高精度的分类任务
层级文本分类依赖将标签组织成结构化层级的分类体系。但许多真实场景中的分类体系存在歧义,例如相似父节点下有相同叶节点名称,导致语言模型难以学习清晰的决策边界。本文提出TaxMorph框架,利用大语言模型对整个分类体系进行重命名、合并、拆分和重新排序等操作,以更好地匹配语言模型所编码的语义。与以往工作不同,该方法不局限于局部调整,而是整体优化分类层级结构。在三个层级文本分类基准上的实验表明,经大模型优化的分类体系在多种设置下均显著优于人工设计的版本,最高提升2.9个百分点的F1值。进一步分析发现,虽然人工分类体系在嵌入空间中聚类更清晰,但大模型优化后的体系更符合模型实际的混淆模式,即尽管更难分离,却更能反映模型的归纳偏置。这说明大模型引导的分类体系优化能更好适配模型学习机制,从而提升分类性能。
原文摘要 · Abstract (English)
Hierarchical text classification (HTC) depends on taxonomies that organize labels into structured hierarchies. However, many real-world taxonomies introduce ambiguities, such as identical leaf names under similar parent nodes, which prevent language models (LMs) from learning clear decision boundaries. In this paper, we present TaxMorph, a framework that uses large language models (LLMs) to transform entire taxonomies through operations such as renaming, merging, splitting, and reordering. Unlike prior work, our method revises the full hierarchy to better match the semantics encoded by LMs. Experiments across three HTC benchmarks show that LLM-refined taxonomies consistently outperform human-curated ones in various settings up to +2.9pp. in F1. To better understand these improvements, we compare how well LMs can assign leaf nodes to parent nodes and vice versa across human-curated and LLM-refined taxonomies. We find that human-curated taxonomies lead to more easily separable clusters in embedding space. However, the LLM-refined taxonomies align more closely with the model's actual confusion patterns during classification. In other words, even though they are harder to separate, they better reflect the model's inductive biases. These findings suggest that LLM-guided refinement creates taxonomies that are more compatible with how models learn, improving HTC performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。