arXiv:2605.08626eess.SPcs.DC2026-05被引 1

让多个设备与云端的AI模型协作,提升资源受限下的智能服务体验

Large Language Models over Networks: Collaborative Intelligence under Resource Constraints

论文配图:Large Language Models over Networks: Collaborative Intelligence under Resource Constraints
图 1 · 摘自论文原文
  • 多端AI通过自然语言协作完成任务,分担计算压力
  • 支持设备-云端垂直协同与多智能体水平协作,可灵活组合
  • 适合低延迟、数据隐私强或网络不稳的边缘应用

大型语言模型(LLMs)正重塑社会,驱动从智能手机助手到自动驾驶的应用。然而,仅靠云端服务难以满足日益增长的应用需求,尤其在间歇性连接、亚秒级延迟预算、数据本地化要求或高并发推理场景下。设备端部署又受限于计算与内存资源。单一终端无法覆盖全场景高质量服务。本文聚焦协同智能,即分布在设备与云端的多个独立LLM通过自然语言或结构化消息在任务层面协作,旨在异构资源约束(计算、内存、通信、成本)下实现更优响应质量。提出两种互补且可组合的协同推理维度:垂直的设备-云协同和水平的多智能体协同,实际中可融合为混合架构。进一步探讨协作学习,涵盖路由策略训练与模型间协作能力构建。最后指出开放挑战,包括资源异构下的可扩展性与可信协同智能。

原文摘要 · Abstract (English)

Large language models (LLMs) are transforming society, powering applications from smartphone assistants to autonomous driving. Yet cloud-based LLM services alone cannot serve a growing class of applications, including those operating under intermittent connectivity, sub-second latency budgets, data-residency constraints, or sustained high-volume inference. On-device deployment is in turn constrained by limited computation and memory. No single endpoint can deliver high-quality service across this spectrum. This article focuses on collaborative intelligence, a paradigm in which multiple independent LLMs distributed across device and cloud endpoints collaborate at the task level through natural language or structured messages. Such collaboration strives for superior response quality under heterogeneous resource constraints spanning computation, memory, communication, and cost across network tiers. We present collaborative inference along two complementary and composable dimensions: vertical device-cloud collaboration and horizontal multi-agent collaboration, which can be combined into hybrid topologies in practice. We then examine learning to collaborate, addressing the training of routing policies and the development of cooperative capabilities among LLMs. Finally, we identify open research challenges including scaling under resource heterogeneity and trustworthy collaborative intelligence.

协同智能边缘计算LLM协作资源约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。