arXiv:2505.16221cs.AI2025-05被引 3

用轻量模型自动选最优LLM组合,省钱又提效

LightRouter: Towards Efficient LLM Collaboration with Minimal Overhead

  • 用自适应机制选少数低成本LLM,减少启动令牌开销
  • 多任务测试中准确率最高提升25%,成本降27%
  • 无需了解模型细节,适合想高效用LLM的开发者

大型语言模型在自然语言处理任务中展现出卓越能力,但不同模型在成本、性能和计算需求上差异显著,给用户选择合适模型带来挑战。本文提出LightRouter框架,从大模型池中系统性筛选并集成少量模型,以联合优化任务表现与成本效率。该框架采用自适应选择机制,仅需极少启动令牌即可识别高效模型,并通过有效融合策略整合输出。多基准测试结果表明,LightRouter在准确率上达到或超越主流集成方法,最高提升25%;相比顶尖高性能模型,其表现相当,但推理成本降低最多达27%。该框架不依赖对单个模型的先验知识,仅使用轻量级模型实现,为高效模型选择提供实用方案,并揭示了最优模型组合策略。

原文摘要 · Abstract (English)

The rapid advancement of large language models has unlocked remarkable capabilities across a diverse array of natural language processing tasks. However, the considerable differences among available LLMs-in terms of cost, performance, and computational demands-pose significant challenges for users aiming to identify the most suitable model for specific tasks. In this work, we present LightRouter, a novel framework designed to systematically select and integrate a small subset of LLMs from a larger pool, with the objective of jointly optimizing both task performance and cost efficiency. LightRouter leverages an adaptive selection mechanism to identify models that require only a minimal number of boot tokens, thereby reducing costs, and further employs an effective integration strategy to combine their outputs. Extensive experiments across multiple benchmarks demonstrate that LightRouter matches or outperforms widely-used ensemble baselines, achieving up to a 25% improvement in accuracy. Compared with leading high-performing models, LightRouter achieves comparable performance while reducing inference costs by up to 27%. Importantly, our framework operates without any prior knowledge of individual models and relies exclusively on inexpensive, lightweight models. This work introduces a practical approach for efficient LLM selection and provides valuable insights into optimal strategies for model combination.

LLM协同成本优化模型选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。