arXiv:2511.02044cs.LGcs.AI2025-11

用伪解释提升大模型分类效果,靠的是结构而非语义。

Regularization Through Reasoning: Systematic Improvements in Language Model Classification via Explanation-Enhanced Fine-Tuning

  • 用随机词序的伪解释替代真解释进行微调
  • 在18个数据集上准确率超越仅标签训练
  • 适合关注模型可靠性与推理过程的研究者

将简短解释附加到标签上进行大语言模型分类微调,可显著提升性能。我们使用多模型生成的集成数据,在70亿参数模型上测试六种对话数据集。在18个不同设置中,带解释的训练均优于仅标签基线。一个意外发现是:即使将真实解释替换为语法混乱但词汇一致的伪解释(如打乱词序或词袋),模型准确率仍高于仅标签训练,并大幅缩小与真实解释的差距。该现象在不同数据集和训练种子下稳定存在,表明收益主要来自结构而非语义——额外的词元预算促使模型产生更丰富的中间计算,起到正则化作用,减少过度自信的捷径依赖。内部分析显示,加入解释的模型在中间层激活熵更高,输出层预测质量更集中,符合决策前更多推敲的特征。说明词元级支架能有效塑造推理过程,提升分类准确性和可靠性。

原文摘要 · Abstract (English)

Fine-tuning LLMs for classification typically maps inputs directly to labels. We ask whether attaching brief explanations to each label during fine-tuning yields better models. We evaluate conversational response quality along three axes: naturalness, comprehensiveness, and on-topic adherence, each rated on 5-point scales. Using ensemble-generated data from multiple LLMs, we fine-tune a 7B-parameter model and test across six diverse conversational datasets. Across 18 dataset, task settings, label-plus-explanation training outperforms label-only baselines. A central and unexpected result concerns random tokens. We replace human-written explanations with text that is syntactically incoherent yet vocabulary-aligned with the originals (e.g., shuffled or bag-of-words variants). Despite lacking semantics, these pseudo-explanations still improve accuracy over label-only training and often narrow much of the gap to true explanations. The effect persists across datasets and training seeds, indicating that gains arise less from meaning than from structure: the extra token budget encourages richer intermediate computation and acts as a regularizer that reduces over-confident shortcuts. Internal analyses support this view: explanation-augmented models exhibit higher activation entropy in intermediate layers alongside sharper predictive mass at the output layer, consistent with increased deliberation before decision. Overall, explanation-augmented fine-tuning, whether with genuine rationales or carefully constructed random token sequences, improves accuracy and reliability for LLM classification while clarifying how token-level scaffolding shapes computation during inference.

大模型微调解释增强正则化推理机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。