提出概率层级约束生成框架,精准控制复杂标签体系下的多级标签输出。
Hierarchical Multi-Label Generation with Probabilistic Level-Constraint
- 将层次多标签分类重构为生成任务,引入概率层级约束控制输出
- 在多个数据集上达到新SOTA,且标签数量、长度和层级控制更精确
- 无需预处理步骤,适合需要高可控性的标签生成场景
层次极端多标签分类相比传统多标签分类更具挑战性,源于领域内标签复杂的层级关系与海量标签。以往研究常依赖聚类等辅助阶段或生成模型但难以控制输出。本文将任务重定义为层次多标签生成(HMG),提出基于概率层级约束(PLC)的生成框架,可在特定领域分类体系中生成具有复杂层级关系的标签。该方法无需预先聚类等操作,即可为每篇文档生成跨层级的所有相关标签,并精确控制输出的标签数量、长度及层级分布。实验表明,该方法不仅在HMG任务上达到新SOTA性能,且在输出控制方面显著优于先前方法。
原文摘要 · Abstract (English)
Hierarchical Extreme Multi-Label Classification poses greater difficulties compared to traditional multi-label classification because of the intricate hierarchical connections of labels within a domain-specific taxonomy and the substantial number of labels. Some of the prior research endeavors centered on classifying text through several ancillary stages such as the cluster algorithm and multiphase classification. Others made attempts to leverage the assistance of generative methods yet were unable to properly control the output of the generative model. We redefine the task from hierarchical multi-Label classification to Hierarchical Multi-Label Generation (HMG) and employ a generative framework with Probabilistic Level Constraints (PLC) to generate hierarchical labels within a specific taxonomy that have complex hierarchical relationships. The approach we proposed in this paper enables the framework to generate all relevant labels across levels for each document without relying on preliminary operations like clustering. Meanwhile, it can control the model output precisely in terms of count, length, and level aspects. Experiments demonstrate that our approach not only achieves a new SOTA performance in the HMG task, but also has a much better performance in constrained the output of model than previous research work.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。