ROS A通过共享GPU池提升工厂机器人推理效率,实现生产力12倍提升
ROSA: A Robotics Foundation Model Serving System for Robot Factories

- 采用共享GPU池,多机器人共用服务器级显卡提升性能与续航
- 支持多模型流水线与任务级性能要求,故障处理更稳定
- 按工厂整体目标调度,而非单任务低延迟,适合大规模智能产线
机器人基础模型(RFM)正推动通用机器人在工厂中的实用化部署。现有服务系统多基于单机器人、单模型假设,将推理视为边缘计算问题,以降低单个动作模型的延迟为目标。本文提出面向机器人工厂的ROSA系统,遵循三大原则:首先,采用共享GPU池服务,使机器人通过网络访问高性能服务器级GPU,提升推理性能、延长电池寿命并提高显卡利用率;其次,提供面向机器人的编程抽象与系统设计,支持多模型流水线、任务级性能需求及故障处理;第三,采用工厂目标驱动的调度策略,最大化符合SLO的工厂整体产能,而非最小化单个请求延迟。ROSA基于Ray Serve构建分布式编排,后端使用vLLM、PyTorch和JAX,结合真实机器人与大规模合成负载进行评估。结果表明,相比传统专用服务系统,ROSA可将工厂生产力提升最高达12.06倍。
原文摘要 · Abstract (English)
Robotics foundation models (RFMs) are making general-purpose robots increasingly practical for factory deployments. While RFM serving systems are central to this vision, existing systems are largely shaped by a single-robot, single-model assumption: inference is treated as an edge-computing problem handled by an on-robot or dedicated nearby GPU, and the serving objective is to minimize the latency of a single action model. In this paper, we propose ROSA, an RFM serving system for robot factories designed around three key principles. First, ROSA adopts shared GPU-pool serving, allowing a fleet of robots to access powerful server-class GPUs over the network in order to improve inference performance, battery duration, and GPU utilization. Second, ROSA provides a robotics-aware programming abstraction and system design that supports multi-model pipelines, per-task performance requirements, and failure handling. Third, ROSA uses factory-objective-driven scheduling to maximize SLO-qualified factory productivity rather than minimizing individual request latency. We implement ROSA on top of Ray Serve for distributed orchestration, with vLLM, PyTorch, and JAX as model-serving backends, and evaluate it on both real robots and synthetic large-scale workloads. The results show that ROSA improves factory productivity by up to 12.06x over conventional dedicated serving systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。