让大模型生成更简洁的推理过程,提升效率不丢性能。
ConciseHint: Boosting Efficient Reasoning via Continuous Concise Hints during Generation
- 生成时注入可学习提示,持续引导模型说人话
- 在DeepSeek-R1等模型上保持性能的同时缩短推理长度
- 适配不同难度问题,兼容现有优化方法
近年来,如DeepSeek-R1和OpenAI o1系列的大规模推理模型通过扩展思维链(Chain-of-Thought, CoT)生成长度,在复杂推理任务上取得显著进展。然而,这些模型常产生过度冗长的推理过程,导致效率低下。现有提升效率的方法多集中于推理前阶段,如提示工程或微调,却忽视了在推理生成过程中直接干预以鼓励简洁表达的潜力。为此,我们提出ConciseHint框架,通过在推理生成过程中持续注入可学习的提示(可人工设计或在简洁数据上学习),引导模型生成更简洁的推理内容。此外,ConciseHint能根据查询复杂度自适应调整提示强度,确保不会损害模型性能。在DeepSeek-R1和Qwen-3系列等前沿大模型上的实验表明,该方法可在保持高准确率的同时有效压缩推理长度。进一步实验显示,ConciseHint具有高度灵活性,可无缝集成到现有方法中,进一步突破效率上限。
原文摘要 · Abstract (English)
Recent advancements in large reasoning models (LRMs) like DeepSeek-R1 and OpenAI o1 series have achieved notable performance enhancements on complex reasoning tasks by scaling up the generation length by Chain-of-Thought (CoT). However, a critical issue is their tendency to produce excessively verbose reasoning processes, leading to the inefficiency problem. Existing literature on improving efficiency mainly adheres to the before-reasoning paradigms such as prompting and reasoning or fine-tuning and reasoning, but ignores the promising direction of directly encouraging the model to speak concisely by intervening during the generation of reasoning. In order to fill the blank, we propose a framework dubbed ConciseHint, which continuously encourages the reasoning model to speak concisely by injecting learnable hints (manually designed or learned on concise data) during the generation of the reasoning. Besides, ConciseHint is adaptive to the complexity of the query by adaptively adjusting the hint intensity, which ensures it will not undermine model performance. Experiments on the state-of-the-art LRMs, including DeepSeek-R1 and Qwen-3 series, demonstrate that our method can effectively produce concise reasoning while maintaining the performance well. Moreover, we show that ConciseHint is flexible and can be seamlessly integrated with existing methods to further push the upper bound of the efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。