arXiv:2604.09150cs.CL2026-04ACL被引 1

通过状态感知与知识引导,让大模型少想几步却更准

Think Less, Know More: State-Aware Reasoning Compression with Knowledge Guidance for Efficient Reasoning

  • 根据推理状态动态选择压缩策略,区分盲目思考与冗余验证
  • 在数学推理任务上压缩59.9%的推理步数,准确率还提升4.8点
  • 适合追求高效精准推理的部署场景,尤其适用于长链推理

大型推理模型(LRMs)通过长链思维(CoT)在复杂任务中表现优异,但常因过度思考导致推理步骤过多、推理延迟高。现有CoT压缩方法难以平衡准确率与效率,且缺乏对冗余和推理偏差的细粒度、逐步适应能力。为此,我们提出状态感知推理压缩框架STACK,通过显式建模不同阶段的冗余来源,并结合检索增强引导机制。STACK构建在线长短对比样本,动态切换知识引导压缩(应对不确定或有偏状态)与自提示压缩(应对过长但自信状态),并引入基于答案收敛的早停机制抑制冗余验证。我们进一步提出基于奖励差值的训练策略,结合近端策略优化(PPO)与直接偏好优化(DPO),使模型学会状态相关的压缩策略。在三个数学推理基准上的实验表明,STACK在准确率-效率平衡上优于现有方法:平均响应长度减少59.9%,准确率提升4.8点。

原文摘要 · Abstract (English)

Large Reasoning Models (LRMs) achieve strong performance on complex tasks by leveraging long Chain-of-Thought (CoT), but often suffer from overthinking, leading to excessive reasoning steps and high inference latency. Existing CoT compression methods struggle to balance accuracy and efficiency, and lack fine-grained, step-level adaptation to redundancy and reasoning bias. Therefore, we propose State-Aware Reasoning Compression with Knowledge Guidance (STACK), a framework that performs step-wise CoT compression by explicitly modeling stage-specific redundancy sources and integrating with a retrieval-augmented guidance. STACK constructs online long-short contrastive samples and dynamically switches between knowledge-guided compression for uncertain or biased reasoning state and self-prompted compression for overly long but confident state, complemented by an answer-convergence-based early stopping mechanism to suppress redundant verification. We further propose a reward-difference-driven training strategy by combining Proximal Policy Optimization (PPO) and Direct Preference Optimization (DPO), enabling models to learn state-conditioned compression strategies. Experiments on three mathematical reasoning benchmarks show that STACK achieves a superior accuracy-efficiency balance, reducing average response length by 59.9% while improving accuracy by 4.8 points over existing methods.

推理压缩链式思维知识引导高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。