arXiv:2508.02209cs.LGcs.AI2025-08被引 4

通过聚合多个小模型提升回答准确率,同时兼顾响应速度。

Balancing Information Accuracy and Response Timeliness in Networked LLMs

  • 构建多模型网络系统,由任务处理器调度专题模型协同回答
  • 聚合结果准确率显著高于单个模型,尤其当各模型性能相近时
  • 适合需要快速高精度响应的场景,如智能客服与医疗问答

大型语言模型(LLMs)在科学发现、内容生成、生物医学文本挖掘和教育技术等领域推动了重大进展。然而,其对训练数据、计算资源和能耗的高需求制约了实际部署。一种有前景的替代方案是使用更小的专用语言模型,并聚合它们的输出以提升整体响应质量。本文研究了一个由多个用户、一个中央任务处理器和多个主题专精的LLM集群组成的网络化LLM系统。每个用户提交二元分类(真/假)查询,由任务处理器路由至选定的包含 $m$ 个LLM的集群。收集各模型响应后,处理器返回聚合结果。我们分析了该设置下的信息准确性和响应及时性,并提出了联合优化框架以平衡这两项相互冲突的目标。大量模拟实验表明,聚合结果的准确率始终优于单个模型,且当参与模型具有相似独立性能时,提升尤为显著。

原文摘要 · Abstract (English)

Recent advancements in Large Language Models (LLMs) have transformed many fields including scientific discovery, content generation, biomedical text mining, and educational technology. However, the substantial requirements for training data, computational resources, and energy consumption pose significant challenges for their practical deployment. A promising alternative is to leverage smaller, specialized language models and aggregate their outputs to improve overall response quality. In this work, we investigate a networked LLM system composed of multiple users, a central task processor, and clusters of topic-specialized LLMs. Each user submits categorical binary (true/false) queries, which are routed by the task processor to a selected cluster of $m$ LLMs. After gathering individual responses, the processor returns a final aggregated answer to the user. We characterize both the information accuracy and response timeliness in this setting, and formulate a joint optimization problem to balance these two competing objectives. Our extensive simulations demonstrate that the aggregated responses consistently achieve higher accuracy than those of individual LLMs. Notably, this improvement is more significant when the participating LLMs exhibit similar standalone performance.

大模型系统模型聚合响应效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。