arXiv:2512.22149cs.DCcs.AI2025-12被引 4

动态分配GPU资源,让多智能体协作推理更快更省。

Adaptive GPU Resource Allocation for Multi-Agent Collaborative Reasoning in Serverless Environments

  • 根据任务负载和优先级实时调整GPU分配
  • 相比轮询调度降低85%延迟,保持高吞吐
  • 适合在服务器无服务器环境中部署多智能体系统

由大语言模型驱动的多智能体系统通过协同智能解决复杂推理任务,展现出巨大潜力。然而,在无服务器GPU平台上高效部署此类系统面临资源分配难题,主要源于智能体工作负载异构、计算需求波动以及成本可控扩展的要求。本文提出一种自适应GPU资源分配框架,采用复杂度为O(N)的算法实现实时调整,在保持与静态分配相当吞吐量的同时,相较轮询调度降低85%延迟。该方法基于工作负载特征、智能体优先级及最低资源需求动态分配资源,有效提升利用率并保障服务质量。针对三大挑战:(1)轻量级协调器与重载专家之间的计算差异;(2)需毫秒级响应的动态负载波动;(3)无服务器环境下的容量限制。通过模拟包含四个异构智能体的真实多智能体工作流进行评估,结果表明自适应分配在延迟、成本和GPU利用率方面均优于静态均分与轮询策略。该框架为在无服务器GPU基础设施上部署低成本高效的多智能体AI系统提供了实用解决方案。

原文摘要 · Abstract (English)

Multi-agent systems powered by large language models have emerged as a promising paradigm for solving complex reasoning tasks through collaborative intelligence. However, efficiently deploying these systems on serverless GPU platforms presents significant resource allocation challenges due to heterogeneous agent workloads, varying computational demands, and the need for cost-effective scaling. This paper presents an adaptive GPU resource allocation framework that achieves 85% latency reduction compared to round-robin scheduling while maintaining comparable throughput to static allocation, using an O(N) complexity algorithm for real-time adaptation. Our approach dynamically allocates GPU resources based on workload characteristics, agent priorities, and minimum resource requirements, enabling efficient utilization while maintaining quality of service. The framework addresses three key challenges: (1) heterogeneous computational demands across lightweight coordinators and heavyweight specialists, (2) dynamic workload fluctuations requiring millisecond-scale reallocation, and (3) capacity constraints in serverless environments. Through comprehensive simulations modeling realistic multi-agent workflows with four heterogeneous agents, we demonstrate that adaptive allocation outperforms static equal and round-robin strategies across latency, cost, and GPU utilization metrics. The framework provides a practical solution for deploying cost-efficient multi-agent AI systems on serverless GPU infrastructure.

多智能体资源分配无服务器推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。