通过智能剪裁冗余推理段落,让大模型思考更高效。
SLAT: Segment-Level Adaptive Trimming for Efficient CoT Reasoning

- 基于推理段落的有用性动态剪裁,不搞一刀切长度限制。
- 在保持准确率的前提下,推理长度减少50%。
- 适合追求高效推理的大模型应用,如AI客服、自动问答。
大型推理模型虽借助强化学习显著提升链式思维(CoT)能力,但生成的推理过程常存在结构冗余(即“过度思考”),导致计算开销大却未提高答案正确率。现有方法多采用统一的令牌长度惩罚,无法区分有效与冗余内容,可能误删有用信息。本文发现效率低下集中在高概率、低边际收益的推理段落中,提出了理论可解释的段落级自适应剪裁框架SLAT。该方法在标准基准测试中实现更优的准确率-效率权衡,在保持竞争力准确率的同时,使推理长度相较原始基线降低50%。结果表明,基于理论指导的段落感知剪裁是提升大模型推理效率的重要方向。
原文摘要 · Abstract (English)
Recent advances in Large Reasoning Models have significantly improved chain-of-thought (CoT) capabilities via reinforcement learning (RL). However, generated reasoning chains frequently suffer from structural redundancy (i.e., \emph{overthinking}), incurring high computational overhead without improving answer correctness. Existing mitigation strategies typically rely on token-uniform length penalties, which provide coarse, segment-agnostic pressure toward shorter outputs and can inadvertently suppress useful reasoning alongside redundancy. To address this, we demonstrate that inefficiency concentrates in high-probability segments with low marginal utility. We derive a theoretical characterization of segment suboptimality under the correctness-length trade-off objective and propose \textsc{SLAT} (Segment-Level Adaptive Trimming), an RL framework that selectively suppresses redundant segments based on this criterion. Empirical results on standard benchmarks indicate that \textsc{SLAT} establishes a superior accuracy-efficiency Pareto frontier, reducing reasoning length by $50\%$ relative to uncompressed baselines while maintaining competitive accuracy. Overall, our results suggest that theoretically grounded, segment-aware trimming is a promising direction for efficient CoT reasoning in large language models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。