arXiv:2508.15507cs.AIcs.LG2025-08被引 2

让大模型按需思考,复杂任务深思,简单任务快答。

Think in Blocks: Adaptive Reasoning from Direct Response to Deep Reasoning

  • 将推理过程分块,由模型自定思考层数
  • 三阶段训练使模型学会根据难度调整推理深度
  • 部署时可动态控制思考长度,兼顾效率与精度

具备思维链的大语言模型在复杂逻辑推理任务中表现优异,但过长的推理链易导致过度思考,造成计算浪费和响应延迟。本文提出 Think in Blocks 框架,实现从零到深度推理的自适应推理:首先预测一个整数形式的推理预算(即块数),再据此划分推理过程。主要贡献包括:(1) 建立显式的分块推理范式,模型先预测推理块数,再相应组织推理;(2) 通过三阶段训练流程——监督微调、基于奖励的直接偏好优化和强化学习,使模型能根据任务难度动态调整推理深度;(3) 利用显式块数,在推理阶段实现推理深度的动态调控,支持部署时灵活调整思维链长度。

原文摘要 · Abstract (English)

Large Language Models (LLMs) with chains-of-thought have demonstrated strong performance on an increasing range of tasks, particularly those involving complex logical reasoning. However, excessively long chains can lead to overthinking, causing computational waste and slower responses. This raises a question: can LLMs dynamically adjust the length of their reasoning processes based on task complexity? To address this, we propose the Think in Blocks framework, which enables adaptive reasoning-from zero to deep reasoning-by partitioning the reasoning process into a tunable number of blocks. Our main contributions are: (1) Establishing an explicit block-structured paradigm in which the model first predicts an integer reasoning budget-the number of blocks-and then partitions its reasoning accordingly; (2) Training an adaptive model through a three-stage pipeline-Supervised Fine-Tuning, reward-guided Direct Preference Optimization, and Reinforcement Learning-that adjusts its reasoning depth to problem difficulty; (3) Exploiting the explicit block count to dynamically control reasoning depth at inference time, allowing flexible adjustment of chain-of-thought length during deployment.

自适应推理思维链大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。