arXiv:2505.18962cs.CL2025-05NeurIPS被引 23

让大模型自动识别关键推理步骤,加速思考过程。

System-1.5 Reasoning: Traversal in Language and Latent Spaces with Dynamic Shortcuts

  • 通过动态跳过非关键步骤,在隐空间中智能分配计算资源。
  • 在GSM8K上推理速度提升20倍,生成token减少92.31%。
  • 适合追求高效精准推理的AI应用开发者使用。

链式思维(CoT)使大语言模型能从快速直觉反应转向深度推理,但伴随大量冗余输出导致效率低下。现有隐空间推理方法虽提升效率,却对所有推理步骤一视同仁,未能区分关键与辅助步骤,造成算力浪费。本文提出System-1.5 Reasoning,一种自适应推理框架,通过隐空间中的动态捷径实现计算资源的智能分配。该方法引入两种动态捷径:模型深度捷径(DS)通过轻量适配器分支提前退出非关键标记,仅让关键标记深入深层Transformer层;步骤捷径(SS)复用解码步间的隐藏状态,跳过冗余步骤,实现横向隐空间推理。训练采用两阶段自蒸馏:先将自然语言链式思维转化为隐空间连续思维,再将完整路径的系统2隐空间推理蒸馏为自适应捷径路径(System-1.5 Reasoning)。实验表明,该方法在多个推理任务中表现优异。例如,在GSM8K上,系统性能接近传统CoT微调方法,同时推理速度提升超20倍,平均生成token减少92.31%。

原文摘要 · Abstract (English)

Chain-of-thought (CoT) reasoning enables large language models (LLMs) to move beyond fast System-1 responses and engage in deliberative System-2 reasoning. However, this comes at the cost of significant inefficiency due to verbose intermediate output. Recent latent-space reasoning methods improve efficiency by operating on hidden states without decoding into language, yet they treat all steps uniformly, failing to distinguish critical deductions from auxiliary steps and resulting in suboptimal use of computational resources. In this paper, we propose System-1.5 Reasoning, an adaptive reasoning framework that dynamically allocates computation across reasoning steps through shortcut paths in latent space. Specifically, System-1.5 Reasoning introduces two types of dynamic shortcuts. The model depth shortcut (DS) adaptively reasons along the vertical depth by early exiting non-critical tokens through lightweight adapter branches, while allowing critical tokens to continue through deeper Transformer layers. The step shortcut (SS) reuses hidden states across the decoding steps to skip trivial steps and reason horizontally in latent space. Training System-1.5 Reasoning involves a two-stage self-distillation process: first distilling natural language CoT into latent-space continuous thought, and then distilling full-path System-2 latent reasoning into adaptive shortcut paths (System-1.5 Reasoning). Experiments on reasoning tasks demonstrate the superior performance of our method. For example, on GSM8K, System-1.5 Reasoning achieves reasoning performance comparable to traditional CoT fine-tuning methods while accelerating inference by over 20x and reducing token generation by 92.31% on average.

推理优化隐空间动态捷径大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。