arXiv:2507.03704cs.CLcs.AI2025-07NeurIPS被引 16

让大模型像人一样快慢自如思考,提升效率与准确率。

Controlling Thinking Speed in Reasoning Models

  • 通过调整模型表征空间中的转向向量控制推理速度
  • 在不训练的前提下,平均提升1.3%准确率,减少8.6%token消耗
  • 适合追求高效推理的部署场景,如实时问答系统

人类认知被认为分为快速直觉的系统1和缓慢深思的系统2。当前大推理模型(LRMs)擅长系统2思维,但缺乏快速思考能力,导致计算开销大、延迟高。本文提出动态调节推理速度的方法,优化准确率与效率的平衡。首先,发现控制快慢思维转换的转向向量,实现基于表征编辑的测试时缩放,优于现有提示工程方法;其次,引入实时难度估计,识别复杂推理阶段。结合两者,提出首种可自适应处理简单步骤与深入分析复杂问题的推理策略。无需额外训练或成本,该插件模块在主流大模型与先进推理基准上实现平均+1.3%准确率、-8.6% token使用。所有算法基于vLLM实现,具备广泛应用潜力。

原文摘要 · Abstract (English)

Human cognition is theorized to operate in two modes: fast, intuitive System 1 thinking and slow, deliberate System 2 thinking. While current Large Reasoning Models (LRMs) excel at System 2 thinking, their inability to perform fast thinking leads to high computational overhead and latency. In this work, we enable LRMs to approximate human intelligence through dynamic thinking speed adjustment, optimizing accuracy-efficiency trade-offs. Our approach addresses two key questions: (1) how to control thinking speed in LRMs, and (2) when to adjust it for optimal performance. For the first question, we identify the steering vector that governs slow-fast thinking transitions in LRMs' representation space. Using this vector, we achieve the first representation editing-based test-time scaling effect, outperforming existing prompt-based scaling methods. For the second question, we apply real-time difficulty estimation to signal reasoning segments of varying complexity. Combining these techniques, we propose the first reasoning strategy that enables fast processing of easy steps and deeper analysis for complex reasoning. Without any training or additional cost, our plug-in module delivers an average +1.3% accuracy with -8.6% token usage across leading LRMs and advanced reasoning benchmarks. All of our algorithms are implemented based on vLLM and are expected to support broader applications and inspire future research.

推理模型思维速度效率优化表征编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。