让大模型自动切换快慢思维,既省 token 又保持高准确率
OThink-R1: Intrinsic Fast/Slow Thinking Mode Switching for Over-Reasoning Mitigation
- 用辅助判别器识别推理中的冗余路径,决定何时该慢思
- 通过混合数据集微调,使模型减少 40% 以上推理耗能
- 适合追求效率与精度平衡的推理场景应用
人类认知包含快速直觉与慢速推理两种模式。通用大语言模型主要采用快速思维,直接生成答案;而近期的大规模推理模型(LRMs)则采用慢速思维,生成详细推理链后才输出结果。尽管 LRMs 准确率更高,但代价是显著增加的 token 消耗。为缓解这一效率-准确率权衡问题,我们提出 OThink-R1,一种在单一 LRM 中融合两种思维模式的混合推理框架,并基于问题特征实现自动模式切换。我们首先识别出 LRM 中三类本质性与冗余性推理轨迹,据此设计一个基于 LLM 的判别器,以自适应判断是否需要慢速思考。利用判别器的决策结果,我们构建了一个混合微调数据集:对冗余推理路径进行剪枝生成快速思维样本,保留完整推理链作为慢速思维样本。该数据集用于微调 LRM,赋予其内在的自主模式选择能力。在数学和问答基准上的大量实验表明,OThink-R1 显著降低了推理 token 使用量,同时保持了具有竞争力的准确率。代码已开源。
原文摘要 · Abstract (English)
Human cognition operates through two complementary modes: fast intuitive thinking and slow deliberate thinking. Vanilla large language models (LLMs) predominantly follow the fast-thinking paradigm, producing immediate responses; while recent large reasoning models (LRMs) adopt slow-thinking strategies, generating detailed reasoning chains before arriving at answers. While LRMs often achieve higher accuracy, this comes at the cost of substantially increased token usage. To address this efficiency-accuracy trade-off, we propose OThink-R1, a hybrid reasoning framework that integrates both modes within a single LRM and enables automatic mode switching based on problem characteristics. We first identify three major patterns of essential and redundant reasoning trajectories in LRMs, which guide the design of an auxiliary LLM-based judge that adaptively determines when slow thinking is necessary. Leveraging the judge's decisions, we construct a hybrid fine-tuning dataset by pruning redundant reasoning to produce fast-thinking samples and retaining complete reasoning for slow-thinking samples. This dataset is then used to fine-tune LRMs, equipping them with inherent autonomous mode-selection capabilities. Extensive experiments on mathematical and question-answering benchmarks show that OThink-R1 reduces reasoning token usage significantly while maintaining competitive accuracy. The code is available at https://github.com/AgenticIR-Lab/OThink-R1.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。