用多模型日志融合不同LLM能力,提升整体性能。
FusionFactory: Fusing LLM Capabilities with Multi-LLM Log Data
- 通过查询、推理和模型三层次融合策略,整合多LLM能力。
- 在14个任务上超越单个最佳LLM,最高提升显著。
- 适合需要灵活部署和多阶段优化的LLM应用开发者。
大型语言模型(LLMs)的快速发展催生了多样化的模型体系,各自在不同任务上表现优异。实践中常使用多个LLM,产生大量多模型日志数据。本文提出是否可充分挖掘这些日志以融合模型互补能力。现有工作虽探索了多LLM集成策略,但缺乏对真实服务场景(如本地与API部署)及不同流水线阶段(如微调与推理)的兼容性与灵活性。为此,我们构建了涵盖5个领域14个任务的大型基准LLMFusionBench,包含20个开源LLM(8B–671B参数)生成的总计10300万词元响应。基于此,提出FusionFactory系统框架,包含三个层级:(1)查询级融合,通过定制化LLM路由器;(2)思维级融合,利用检索到的抽象推理模板;(3)模型级融合,基于排名靠前响应进行蒸馏。实验表明,FusionFactory在全部14个基准上均优于单一最优模型,且最优融合配置因任务而异,证明多模型日志是融合多样化能力的实用基础。
原文摘要 · Abstract (English)
The rapid advancement of large language models (LLMs) has created a diverse landscape of models, each excelling at different tasks. This diversity drives researchers to employ multiple LLMs in practice, leaving behind valuable multi-LLM log data. This naturally leads to the question of whether such logs can be fully leveraged to fuse LLMs' complementary capabilities. Although prior work has explored various strategies for integrating multiple LLMs, we argue that practical fusion must meet two essential requirements: (1) compatibility with real-world serving scenarios (e.g., local and API-based serving), and (2) flexibility to operate at different stages of the LLM pipeline to meet varied user needs (e.g., fine-tuning and inference stages). To this end, we introduce LLMFusionBench, a large-scale benchmark for LLM fusion that spans 14 tasks across five domains, with responses from 20 open-source LLMs (8B--671B) totaling 103M tokens. Building on LLMFusionBench, we propose FusionFactory, a systematic framework with three elaborated levels: (1) query-level fusion via tailored LLM routers, (2) thought-level fusion leveraging retrieved abstract reasoning templates, and (3) model-level fusion via distillation from top-ranked responses. Experiments show that FusionFactory consistently outperforms the best individual LLM across all 14 benchmarks, with the optimal fusion configuration varying across benchmarks, highlighting the promise of multi-LLM log data as a practical foundation for fusing diverse LLM capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。