arXiv:2504.00424cs.AI2025-04被引 12

用精简推理链提升大模型效率,响应更快更清晰。

Hawkeye:Efficient Reasoning with Model Collaboration

  • 让大模型生成简洁推理指令,小模型据此生成答案。
  • 仅用35%的推理token,效果相当且更清晰流畅。
  • 复杂数学任务提速3.4倍,成本降低60%,适合高效推理场景。

链式思维(CoT)推理显著提升了大语言模型的推理能力,但其效率受限于大量冗余的中间推理标记,导致计算开销和延迟过高。本文发现多数CoT标记实属冗余,仅保留少量即可生成高质量回答。为此,我们提出HAWKEYE——一种后训练与推理框架,由大模型生成精炼的CoT指令,指导小模型生成回应。HAWKEYE通过强化学习量化推理冗余并提炼高密度信息。实验表明,使用仅35%的完整CoT,HAWKEYE可达到相近的响应质量,同时提升清晰度、连贯性和简洁性约10%。在复杂数学任务中,可实现端到端推理速度提升3.4倍,推理成本降低最高达60%。HAWKEYE将开源,模型即将发布。

原文摘要 · Abstract (English)

Chain-of-Thought (CoT) reasoning has demonstrated remarkable effectiveness in enhancing the reasoning abilities of large language models (LLMs). However, its efficiency remains a challenge due to the generation of excessive intermediate reasoning tokens, which introduce semantic redundancy and overly detailed reasoning steps. Moreover, computational expense and latency are significant concerns, as the cost scales with the number of output tokens, including those intermediate steps. In this work, we observe that most CoT tokens are unnecessary, and retaining only a small portion of them is sufficient for producing high-quality responses. Inspired by this, we propose HAWKEYE, a novel post-training and inference framework where a large model produces concise CoT instructions to guide a smaller model in response generation. HAWKEYE quantifies redundancy in CoT reasoning and distills high-density information via reinforcement learning. By leveraging these concise CoTs, HAWKEYE is able to expand responses while reducing token usage and computational cost significantly. Our evaluation shows that HAWKEYE can achieve comparable response quality using only 35% of the full CoTs, while improving clarity, coherence, and conciseness by approximately 10%. Furthermore, HAWKEYE can accelerate end-to-end reasoning by up to 3.4x on complex math tasks while reducing inference cost by up to 60%. HAWKEYE will be open-sourced and the models will be available soon.

推理优化链式思维模型协作效率提升

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。