arXiv:2505.19716cs.AI2025-05被引 21

用难度感知提示精简推理链,少用 tokens 也能保持高准确率。

Concise Reasoning, Big Gains: Pruning Long Reasoning Trace with Difficulty-Aware Prompting

  • 根据题目难度动态压缩推理过程,避免冗余
  • 新数据集 LiteCoT 平均仅 720 token,比原版短一个数量级
  • 小样本训练即超越大样本原版,适合资源有限场景

现有链式思维(CoT)蒸馏方法虽能有效迁移推理能力,但存在推理链过长和难易适应性差两大问题。长推理链显著增加推理开销,统一长度的解法也阻碍学生模型学习自适应策略。为此,我们提出难度感知提示(DAP)方法,让大模型先判断题目难度,再重写为合适长度的简洁推理链,实现无性能损失的精简。基于此流程,我们构建了包含10万条简洁推理样本的 LiteCoT 数据集,平均仅720个token(较典型CoT缩短一个数量级)。利用 LiteCoT,我们在 Qwen2.5 架构上蒸馏出 Liter 系列模型(1.5B、7B、32B)。实验表明,仅用10万条精简样本微调的学生模型,性能优于使用80万条原始长链蒸馏的模型,且训练与推理成本大幅降低。在11个不同基准测试中,短而智能的推理链表现持平或更优,例如在挑战性的 AIME24 考试中,仅用约5千推理词元就达到74.2%的 Pass@1,优于消耗更多词元的方法。代码与数据已开源。

原文摘要 · Abstract (English)

Existing chain-of-thought (CoT) distillation methods can effectively transfer reasoning abilities to base models but suffer from two major limitations: excessive verbosity of reasoning traces and inadequate adaptability to problem difficulty. Long reasoning traces significantly increase inference costs, and uniform-length solutions prevent base models from learning adaptive reasoning strategies. To address these issues, we propose a difficulty-aware prompting (DAP) method to dynamically shorten reasoning traces without performance loss. In our approach, a large teacher model first judges each problem's difficulty and then rewrites its reasoning traces to an appropriate shorter length, yielding concise yet complete reasoning traces. Leveraging the DAP pipeline, we curate a distilled dataset called LiteCoT consisting of 100K concise reasoning examples, with solutions averaging only 720 tokens (an order of magnitude shorter than typical CoTs). Using LiteCoT, we distilled a new family of reasoning models called Liter (1.5B, 7B, and 32B) based on the Qwen2.5 architecture. Experiments show that a student model fine-tuned on just 100K of these difficulty-pruned CoT samples outperforms a model distilled on 800K original Long CoT samples, while significantly reducing training and inference costs. Our method also generalizes well: across 11 diverse benchmarks, the shorter difficulty-aware CoTs achieve equal or better accuracy than Long chains, using far fewer tokens. For example, on the challenging AIME24 exam, our approach reaches $74.2\%$ Pass@1 using only about 5K inference tokens, surpassing other methods that consume many more tokens. Our code and data are available at https://github.com/Evanwu1125/LiteCoT.

链式思维模型压缩推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。