通过控制大模型推理长度,提升准确率并加快响应速度。
Overclocking LLM Reasoning: Monitoring and Controlling Thinking Path Lengths in LLMs
- 用进度条可视化模型推理过程,揭示思维动态。
- 缩短无效推理步骤,准确率提升12.3%,延迟降低28%。
- 适合需要高效精准推理的应用场景。
近期研究表明,通过显式结构化推理可实现强大的测试时扩展性能,其关键在于将模型内部的“思考”过程与最终输出分离。推理阶段的长度直接影响答案质量:过短则无法捕捉任务复杂性,过长则导致过度思考,增加计算开销且性能下降。本文探索并利用大模型在显式思考过程中理解与调控推理长度的内在机制。首先,我们发现模型会编码推理进程,并提出交互式进度条可视化工具,揭示其规划动态;其次,在推理时操纵内部进度编码,减少冗余步骤,生成更简洁、果断的思维链。实证结果表明,该‘超频’方法有效缓解过度思考,提升答案准确率,同时降低推理延迟。代码已公开。
原文摘要 · Abstract (English)
Recently, techniques such as explicit structured reasoning have demonstrated strong test-time scaling behavior by enforcing a separation between the model's internal "thinking" process and the final response. A key factor influencing answer quality in this setting is the length of the thinking stage. When the reasoning is too short, the model may fail to capture the complexity of the task. Conversely, when it is too long, the model may overthink, leading to unnecessary computation and degraded performance. This paper explores and exploits the underlying mechanisms by which LLMs understand and regulate the length of their reasoning during explicit thought processes. First, we show that LLMs encode their progress through the reasoning process and introduce an interactive progress bar visualization, which is then used to reveal insights on the model's planning dynamics. Second, we manipulate the internal progress encoding during inference to reduce unnecessary steps and generate a more concise and decisive chain of thoughts. Our empirical results demonstrate that this "overclocking" method mitigates overthinking, improves answer accuracy, and reduces inference latency. Our code is publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。