小模型遇难题时才向大模型求助,精准提效不啰嗦。
MentorCollab: Large-to-Small Inference-Time Mentorship for Concise Reasoning in Language Models
- 小模型主导生成,仅在关键节点向大模型求助并验证。
- 平均提升3.0%准确率,部分场景达8.0%提升,输出更短。
- 适合追求高效简洁推理的部署场景,如移动端或实时应用。
大型推理模型(LRMs)虽具备强大推理能力,但结果冗长且计算开销高,用户阅读负担重。小型语言模型(SLMs)生成简洁、成本低,但在复杂多步任务上表现不佳。现有推理阶段协作方法通过模仿让小模型跟随大模型,但常导致小模型过度思考,产生冗长推理链且准确率仍不足。我们提出MentorCollab,一种基于导师制的协作方法:小模型作为主生成者,在稀疏采样的词元位置检测两模型分歧,由轻量级验证器判断是否采纳大模型的简短前瞻片段。在15组SLM-LRM配对及3个领域中,平均提升3.0%,12种情况下最高达8.0%。生成轨迹比大模型更短,仅使用其少量词元。结果表明,选择性且经验证的导师指导可提升推理准确性同时保持简洁输出。
原文摘要 · Abstract (English)
Large reasoning models (LRMs) have demonstrated impressive reasoning capabilities, but their solutions are often verbose and computationally expensive, and taxing for users to read. In contrast, small language models (SLMs) produce concise outputs with lower inference costs, yet they frequently struggle on challenging multi-step reasoning tasks. Existing inference-time collaboration methods attempt to bridge this gap through imitation, encouraging SLMs to follow the reasoning process of LRMs. However, the student often inherits the mentor's overthinking, producing long and reflective reasoning chains while still falling short in accuracy. We propose MentorCollab, a collaboration method based on mentorship: the SLM remains the primary generator and consults the LRM only when additional reasoning support is needed. At sparsely sampled token positions, we probe for divergence between the two models and use a lightweight verifier to decide whether the SLM should follow a short lookahead segment from its mentor or continue on its own. Across 15 SLM-LRM pairs and 3 domains, our method achieves an average gain of 3.0%, with improvements of up to 8.0% in 12 settings. The resulting traces remain shorter than the mentor's, using only a small fraction of its tokens. These results demonstrate that selective, verified mentorship can boost reasoning accuracy while preserving concise generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。