arXiv:2605.13165cs.CL2026-05

通过结构化剪枝减少长链推理冗余,提升低数据场景下的推理效率。

STOP: Structured On-Policy Pruning of Long-Form Reasoning in Low-Data Regimes

论文配图:STOP: Structured On-Policy Pruning of Long-Form Reasoning in Low-Data Regimes
图 1 · 摘自论文原文
  • 构建自蒸馏推理路径,通过节点分割与树状结构分析实现可解释剪枝。
  • 在低数据微调下减少19.4%-42.4%生成 token,保持准确率稳定。
  • 适合资源受限场景的高效推理优化,尤其适用于小样本部署。

长链思维(Long CoT)能提升多步问题的性能,但常引发过度思考:模型生成大量低效推理,增加推理成本和延迟。这一问题在低数据微调场景下尤为严重,因缺乏大规模教师蒸馏或复杂测试时控制手段。为此,我们提出 STOP(Structured On-policy Pruning),一种基于策略的长推理剪枝算法。STOP 从模型自身生成自蒸馏推理轨迹,通过节点分割、分类标注与推理树构建,将其映射为结构化推理接口。在此基础上引入 ECN(最早正确节点),保留首个既可作为答案结论又给出正确结果的最短前缀,剔除冗余的解答后验证与回溯内容,同时维持语义连贯性。在 DeepSeek-R1-Distill-Qwen-7B 与 DeepSeek-R1-Distill-LLaMA-3-8B 模型上,于 GSM8K、Math 500 与 AIME 2024 数据集上的实验表明,STOP 在低数据微调下可减少 19.4%-42.4% 的生成 token,同时基本保持准确率。分析还显示,相比教师引导剪枝,STOP 引发的分布偏移更小,显著提升推理结构效率,并将推理精力从冗余验证转向更有产出的探索。

原文摘要 · Abstract (English)

Long chain-of-thought (Long CoT) reasoning improves performance on multi-step problems, but it also induces overthinking: models often generate low-yield reasoning that increases inference cost and latency. This inefficiency is especially problematic in low-data fine-tuning regimes, where real applications adapt reasoning models with limited supervision and cannot rely on large-scale teacher distillation or heavy test-time control. To address this, we propose STOP (Structured On-policy Pruning), an on-policy algorithm for analyzing and pruning long-form reasoning traces. STOP constructs self-distilled traces from the model. Then it maps each trace into a structured reasoning interface through node segmentation, taxonomy annotation, and reasoning-tree construction. On top of this interface, we introduce ECN (Earliest Correct Node), which retains the shortest prefix ending at the earliest node that both functions as an answering conclusion and yields the correct final answer, removing redundant post-solution reasoning while preserving semantic continuity. Experiments on DeepSeek-R1-Distill-Qwen-7B and DeepSeek-R1-Distill-LLaMA-3-8B across GSM8K, Math 500, and AIME 2024 show that STOP reduces generated tokens by 19.4-42.4% while largely preserving accuracy in low-data fine-tuning. Beyond efficiency, our analyses show that STOP induces much smaller distributional shift than teacher-guided pruning, improves the structural efficiency of generated reasoning, and reallocates reasoning effort away from redundant verification and backtracking toward more productive exploration.

推理优化剪枝低数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。