让AI像推理一样逐步判断专利分类,提升准确率与可解释性。
Reasoning for Hierarchical Text Classification: The Case of Patents
- 将专利分类转为分步推理任务,用大模型逐步推导层级标签。
- 准确率和宏F1比基线高约3%,且在大模型上表现更优。
- 生成自然语言解释,适合需要透明决策的场景如专利审查。
层次化文本分类(HTC)将文档分配到预定义分类体系的多层结构中。自动化专利主题分类是其中最具挑战性的场景之一,因其领域知识复杂且标签数量庞大。现有方法仅输出扁平标签集,难以揭示预测依据。为此,我们提出面向层次化分类的推理框架(RHC),将HTC重构为分步推理任务,逐步推导层级标签。RHC通过两阶段训练大语言模型:第一阶段冷启动对齐链式思维(CoT)格式输出,第二阶段采用强化学习提升多步推理能力。实验表明,RHC具备四大优势:(1)有效性:相比以往基线,准确率和宏F1提升约3%;(2)可解释性:预测前生成自然语言理由,便于人工核查;(3)可扩展性:随模型规模增大表现更佳,优于标准微调;(4)适用性:在多个主流HTC基准上均达到领先性能,证明其广泛适用性。
原文摘要 · Abstract (English)
Hierarchical text classification (HTC) assigns documents to multiple levels of a pre-defined taxonomy. Automated patent subject classification represents one of the hardest HTC scenarios because of domain knowledge difficulty and a huge number of labels. Prior approaches only output a flat label set, which offers little insight into the reason behind predictions. Therefore, we propose Reasoning for Hierarchical Classification (RHC), a novel framework that reformulates HTC as a step-by-step reasoning task to sequentially deduce hierarchical labels. RHC trains large language models (LLMs) in two stages: a cold-start stage that aligns outputs with chain-of-thought (CoT) reasoning format and a reinforcement learning (RL) stage to enhance multi-step reasoning ability. RHC demonstrates four advantages in our experiments. (1) Effectiveness: RHC surpasses previous baselines and outperforms the supervised fine-tuning counterparts by approximately 3% in accuracy and macro F1. (2) Explainability: RHC produces natural-language justifications before prediction to facilitate human inspection. (3) Scalability: RHC scales favorably with model size with larger gains compared to standard fine-tuning. (4) Applicability: Beyond patents, we further demonstrate that RHC achieves state-of-the-art performance on other widely used HTC benchmarks, which highlights its broad applicability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。