arXiv:2608.21860cs.LGcs.AI2026-08被引 1

解决大模型推理冗余问题,让思维链更短更高效

ChainPrune: Evaluating and Reducing Redundancy in Long Chain-of-Thought Reasoning

论文配图:ChainPrune: Evaluating and Reducing Redundancy in Long Chain-of-Thought Reasoning
图 1 · 摘自论文原文
  • 构建树状推理结构,筛选关键步骤生成优质训练数据
  • 推理步数减少40%以上,计算开销降低,准确率不降反升
  • 适合需要高效推理的智能助手、自动编程等场景

思维链(CoT)推理显著提升了大语言模型的多步问题求解能力,但先进大推理模型常出现过度思考现象,表现为推理步骤过长、冗余严重及计算开销高。现有基于令牌长度的奖励策略虽能缩短输出,却易导致伪简洁——即文本变短但冗余仍在,链条更长且结构低效。为此,我们提出ChainPrune,一种新型推理路径语义结构优化方法,可高效可控地合成自生成高质量训练数据。首先将自生成的推理路径整合为树形结构,再通过多准则主导路径选择构建偏好数据,形成浅层但保留核心步骤的推理轨迹。为进一步提升推理质量,引入基于直接偏好优化(DPO)的偏好学习方法,并结合监督损失,有效缓解虚假奖励抑制问题。实验表明,该方法显著减少推理步数与计算开销,同时保持甚至提升准确性。

原文摘要 · Abstract (English)

Chain-of-Thought (CoT) reasoning has significantly enhanced the multi-step problem-solving capabilities of large language models (LLMs) by introducing explicit intermediate reasoning. However, advanced Large Reasoning Models (LRMs) often exhibit overthinking behaviors, including excessively long reasoning steps, redundant steps, and high computational overhead. Existing token-length reward strategies aim to promote concise outputs, but often result in pseudo-conciseness, where token count is reduced, yet redundant reasoning persists, leading to longer and less structurally efficient chains. To address these limitations, we propose ChainPrune, a novel reasoning path semantic structural optimization method to efficiently and controllably synthesize self-generated high-quality training data. We initially consolidate self-generated reasoning paths into a tree-based structure, followed by a multi-criteria dominant path selection process for preference data construction that formulates shallow reasoning trajectories while preserving essential reasoning steps. To further enhance the quality of reasoning, we incorporate a DPO-based preference learning method combined with supervised loss, effectively mitigating false reward suppression. This innovative integration significantly enhances both the efficiency and effectiveness of our reasoning framework. Comprehensive experimental results demonstrate significant reductions in step length and computational overhead, while maintaining or even enhancing accuracy.

思维链推理优化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。