arXiv:2507.00214cs.CLcs.AI2025-07被引 5

用大模型生成推理链,让分类模型准确率提升8.7个百分点

Two-Stage Reasoning-Infused Learning: Improving Classification with LLM-Generated Reasoning

  • 分两阶段训练:先生成推理文本,再用推理+答案联合训练分类器
  • 在情感分类任务上,准确率比纯输出标签的模型高8.7个百分点
  • 适合需要可解释性的场景,如医疗、金融等高风险领域

标准分类模型通常直接将输入映射到标签,缺乏显式推理过程,可能限制其性能、鲁棒性和可解释性。本文提出一种两阶段方法,通过大语言模型(LLM)生成推理链来增强文本分类。第一阶段在通用推理数据集(syvai/reasoning-gen)上微调Llama-3.2-1B-Instruct模型(简称Llama-R-Gen),使其根据问题和答案生成文本推理(R)。第二阶段,该预训练的Llama-R-Gen离线生成推理文本,构建增强型训练数据集,用于训练下游生成模型。该模型基于Llama-3.2-1B-Instruct,仅接收输入文本(Q),目标是输出生成的推理(R)后接预测的情感标签(A)。我们在dair-ai/emotion数据集上验证该方法。实验表明,训练为输出推理与情感(Classifier Q->RA)的生成模型相比仅输出情感的基线模型(Classifier Q->A),在情感预测上准确率提升8.7个百分点,凸显了推理生成的强泛化能力及显式推理训练的优势。本工作展示了LLM生成推理在构建更丰富训练数据集方面的潜力,有助于提升多种下游NLP任务性能并提供可解释性。

原文摘要 · Abstract (English)

Standard classification models often map inputs directly to labels without explicit reasoning, potentially limiting their performance, robustness, and interpretability. This paper introduces a novel two-stage approach to enhance text classification by leveraging Large Language Model (LLM)-generated reasonings. In the first stage, we fine-tune a Llama-3.2-1B-Instruct model (henceforth Llama-R-Gen) on a general-purpose reasoning dataset (syvai/reasoning-gen) to generate textual reasoning (R) given a question and its answer. In the second stage, this generally trained Llama-R-Gen is used offline to create an augmented training dataset for a downstream generative model. This downstream model, based on Llama-3.2-1B-Instruct, takes only the input text (Q) and is trained to output the generated reasoning (R) immediately followed by the predicted emotion (A). We demonstrate this methodology on the dair-ai/emotion dataset for emotion classification. Our experiments show that the generative model trained to output reasoning and the emotion (Classifier Q->RA) achieves a significant improvement of 8.7 percentage points in accuracy (for emotion prediction) compared to a baseline generative model trained solely to output the emotion (Classifier Q->A), highlighting the strong generalization capabilities of the reasoning generation and the benefit of explicit reasoning training. This work underscores the potential of LLM-generated reasonings for creating richer training datasets, thereby improving the performance of diverse downstream NLP tasks and providing explicit explanations.

大模型推理分类增强可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。