让多个大模型通过客户端-服务器协作,提升单个模型的推理能力。
CoLM: Collaborative Large Models via A Client-Server Paradigm
- 客户端与服务器模型协同,共享高质量输出供本地迭代优化。
- 在多个基准测试中,显著提升模型对过往失败查询的处理能力。
- 适用于语言和视觉语言模型,适合实际部署场景下的模型增强。
大模型在各类推理与理解任务中表现卓越。以往工作常采用模型集成或多智能体系统实现协作,但这些方法多基于服务器间直接交互,难以匹配现代互联网架构下多个客户端共享有限服务端模型的实际部署环境。本文提出一种新型协作推理框架 CoLM(Collaboration in Large-Models),从客户端-服务器视角重构大模型间的协作机制。不同于传统集成方法依赖多个模型同时推理生成单一输出,CoLM 允许多模型输出被聚合或共享,使每个客户端模型可独立依据高质量输出进行自我修正与更新。该设计充分利用了客户端与共享服务端模型的协同潜力。我们进一步将 CoLM 扩展至视觉语言模型(VLMs),验证其在非语言任务中的适用性。实验结果表明,CoLM 在多个基准测试中均能有效提升模型对先前失败查询的处理性能,证明协作引导对增强单模型能力的有效性。
原文摘要 · Abstract (English)
Large models have achieved remarkable performance across a range of reasoning and understanding tasks. Prior work often utilizes model ensembles or multi-agent systems to collaboratively generate responses, effectively operating in a server-to-server paradigm. However, such approaches do not align well with practical deployment settings, where a limited number of server-side models are shared by many clients under modern internet architectures. In this paper, we introduce \textbf{CoLM} (\textbf{Co}llaboration in \textbf{L}arge-\textbf{M}odels), a novel framework for collaborative reasoning that redefines cooperation among large models from a client-server perspective. Unlike traditional ensemble methods that rely on simultaneous inference from multiple models to produce a single output, CoLM allows the outputs of multiple models to be aggregated or shared, enabling each client model to independently refine and update its own generation based on these high-quality outputs. This design enables collaborative benefits by fully leveraging both client-side and shared server-side models. We further extend CoLM to vision-language models (VLMs), demonstrating its applicability beyond language tasks. Experimental results across multiple benchmarks show that CoLM consistently improves model performance on previously failed queries, highlighting the effectiveness of collaborative guidance in enhancing single-model capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。