解决大模型推理慢、耗资源的问题,提升效率同时保持思考质量。
Efficient Inference for Large Reasoning Models: A Survey
- 分显式压缩思维链与隐式潜在思维链两类方法,降低推理开销。
- 实证分析表明新方法在保持推理准确率的同时减少30%以上token消耗。
- 适合关注模型高效部署、可解释性与安全性的研究者参考。
大型推理模型(LRMs)通过学习推理能力显著提升了大语言模型(LLMs)的复杂任务解决能力,但其逐步推理过程导致了令牌使用效率低、内存占用高和推理时间长等问题。本文综述了专为LRMs设计的高效推理方法,重点缓解令牌效率问题并保持推理质量。我们提出一个分类体系,将近期方法分为两类:(a) 显式紧凑思维链(CoT),在保留显式推理结构的同时减少令牌数量;(b) 隐式潜在思维链,将推理步骤编码在隐藏表示中而非显式令牌。我们进一步从推理场景、目标函数及性能与效率角度进行实证分析。此外,本文还指出该领域面临的开放挑战,包括面向人类可控的推理、可解释性与效率的权衡、高效推理的安全保障以及更广泛的应用前景。最后,我们强调通过模型融合、新型架构和代理路由等技术提升推理效率的关键洞见。相关论文与代码汇总见:https://github.com/yueliu1999/Awesome-Efficient-Inference-for-LRMs。
原文摘要 · Abstract (English)
Large Reasoning Models (LRMs) significantly improve the reasoning ability of Large Language Models (LLMs) by learning to reason, exhibiting promising performance in solving complex tasks. However, their deliberative reasoning process leads to inefficiencies in token usage, memory consumption, and inference time. Thus, this survey provides a review of efficient inference methods designed specifically for LRMs, focusing on mitigating token inefficiency while preserving the reasoning quality. The overview structure of this paper is shown in Figure~\ref{fig:paper_structure}. First, we introduce a taxonomy to group the recent methods into two main categories: (a) explicit compact Chain-of-Thought (CoT), which reduces tokens while keeping the explicit reasoning structure, and (b) implicit latent CoT, which encodes reasoning steps within hidden representations instead of explicit tokens. Meanwhile, we discuss their strengths and weaknesses. Then, we conduct empirical analyses on existing methods from reasoning scenarios, object functions, and performance \& efficiency aspects. Besides, we present open challenges in this field, including human-centric controllable reasoning, trade-off between interpretability and efficiency of reasoning, ensuring the safety of efficient reasoning, and broader applications of efficient reasoning. In addition, we highlight key insights for enhancing LRMs' inference efficiency via techniques such as model merging, new architectures, and agent routers. We hope this work serves as a valuable guide, helping researchers overcome challenges in this vibrant field. A collection of efficient reasoning methods for LRMs (papers and codes) is provided at this link: https://github.com/yueliu1999/Awesome-Efficient-Inference-for-LRMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。