通过模型合并实现大模型推理能力的精细调控,平衡准确率与效率。
The Thinking Spectrum: An Empirical Study of Tunable Reasoning in LLMs through Model Merging
- 用加权合并通用模型与专用推理模型的权重,生成不同推理深度的模型。
- 在多个基准上构建精度-效率曲线,验证可调性并发现帕累托改进实例。
- 适合需要定制化推理能力的部署场景,如低延迟高精度应用。
随着实际应用对具备可调推理能力的大语言模型需求增长,高效生成在推理深度与计算成本间平衡的模型成为关键挑战。模型合并作为一种无需训练的有前景技术,通过算术组合通用模型与专用推理模型的权重来应对该问题。尽管已有多种合并方法,其在创建具有细粒度推理控制能力的模型谱系方面的潜力仍待探索。本文开展大规模实证研究,评估多种模型合并技术在多个推理基准上的表现。系统性地调节合并强度,构建出准确率-效率曲线,首次提供对可调性能空间的全面视图。结果表明,模型合并能有效且可控地调节推理准确率与分词效率之间的权衡,即使父模型权重空间差异显著亦然。尤为重要的是,我们发现了帕累托改进现象:某些合并模型在准确率更高且消耗更少分词数方面优于任一父模型。本研究首次系统分析了这一可调空间,为满足多样化应用需求而构建特定推理特性的大模型提供了实用指导。
原文摘要 · Abstract (English)
The growing demand for large language models (LLMs) with tunable reasoning capabilities in many real-world applications highlights a critical need for methods that can efficiently produce a spectrum of models balancing reasoning depth and computational cost. Model merging has emerged as a promising, training-free technique to address this challenge by arithmetically combining the weights of a general-purpose model with a specialized reasoning model. While various merging techniques exist, their potential to create a spectrum of models with fine-grained control over reasoning abilities remains largely unexplored. This work presents a large-scale empirical study evaluating a range of model merging techniques across multiple reasoning benchmarks. We systematically vary merging strengths to construct accuracy-efficiency curves, providing the first comprehensive view of the tunable performance landscape. Our findings reveal that model merging offers an effective and controllable method for calibrating the trade-off between reasoning accuracy and token efficiency, even when parent models have highly divergent weight spaces. Crucially, we identify instances of Pareto Improvement, where a merged model achieves both higher accuracy and lower token consumption than one of its parents. Our study provides the first comprehensive analysis of this tunable space, offering practical guidelines for creating LLMs with specific reasoning profiles to meet diverse application demands.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。