通过激活空间流形调控,减少大模型推理中的冗余思考。
Mitigating Overthinking in Large Reasoning Models via Manifold Steering
- 发现过思考源于激活空间的低维流形,通过投影干预方向提升效率。
- 在数学任务上减少71%输出token,准确率不降反升。
- 方法通用性强,适用于代码生成与知识问答任务。
大型推理模型在数学与编程等复杂任务中表现出色,但推理时常出现过思考现象,表现为过多验证循环与重复推敲,导致巨大计算开销。本文从机制可解释性角度研究该问题,发现过思考倾向可由激活空间中的单一方向有效捕捉,但过度干预反而导致性能下降。进一步分析表明,过思考实际关联一个低维流形,受限于高维干预方向引入的噪声。为此,提出流形引导(Manifold Steering)方法,将干预方向投影至理论近似的干扰噪声流形上。在DeepSeek-R1蒸馏模型上的大量实验表明,该方法在多个数学基准上实现最高71%的输出词元减少,且准确率保持甚至提升。方法还具备强跨领域迁移能力,在代码生成与知识问答任务中均表现稳定。代码已开源:https://github.com/Aries-iai/Manifold_Steering。
原文摘要 · Abstract (English)
Recent advances in Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in solving complex tasks such as mathematics and coding. However, these models frequently exhibit a phenomenon known as overthinking during inference, characterized by excessive validation loops and redundant deliberation, leading to substantial computational overheads. In this paper, we aim to mitigate overthinking by investigating the underlying mechanisms from the perspective of mechanistic interpretability. We first showcase that the tendency of overthinking can be effectively captured by a single direction in the model's activation space and the issue can be eased by intervening the activations along this direction. However, this efficacy soon reaches a plateau and even deteriorates as the intervention strength increases. We therefore systematically explore the activation space and find that the overthinking phenomenon is actually tied to a low-dimensional manifold, which indicates that the limited effect stems from the noises introduced by the high-dimensional steering direction. Based on this insight, we propose Manifold Steering, a novel approach that elegantly projects the steering direction onto the low-dimensional activation manifold given the theoretical approximation of the interference noise. Extensive experiments on DeepSeek-R1 distilled models validate that our method reduces output tokens by up to 71% while maintaining and even improving the accuracy on several mathematical benchmarks. Our method also exhibits robust cross-domain transferability, delivering consistent token reduction performance in code generation and knowledge-based QA tasks. Code is available at: https://github.com/Aries-iai/Manifold_Steering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。