arXiv:2608.03682cs.AIcs.RO2026-08

统一物理AI推理引擎,云端边缘高效部署。

PhyAI: Real-Time Physical AI at the Edge, Scalable Rollouts in the Cloud

论文配图:PhyAI: Real-Time Physical AI at the Edge, Scalable Rollouts in the Cloud
图 1 · 摘自论文原文
  • 一套运行时支持多场景物理AI推理,共享核心计算资源。
  • 实测速度比官方实现快1.40至4.65倍,8块H20 GPU延迟降至1.18秒。
  • 适配新模型快速,适合机器人、智能系统研发团队使用。

物理AI策略在其全生命周期中需持续推理,涵盖模型评估、云端强化学习推演、边缘GPU服务及机载部署。尽管这些场景共享相同检查点与动作语义,却常依赖独立推理程序。为此,我们构建了PhyAI——一个统一的物理AI推理引擎,通过单一运行时保留架构特异性条件、求解器、缓存与输出逻辑,同时共享图执行、内核、内存管理与并行服务。同一代码库可在单/多GPU上运行视觉-语言-动作(VLA)模型与世界-动作模型(WAM),覆盖机载、边缘与云端部署。利用适配器接口,我们在MiniCPM-Robot发布当日即完成集成。PhyAI在pi0、pi0.5、GR00T N1.7和MiniCPM-Robot上实现1.40x-4.65x加速。在Cosmos3-Nano-Policy-DROID上,8块H20 GPU(CFG=2, TP=4)下延迟由2.46秒降至1.18秒,提速2.08倍。特定配置下专用运行时仍更快,目标为具备竞争力延迟的一体化运行时,而非各场景最优。详细性能分析显示:在单批Hopper GPU上,pi0.5动作专家占8.8%算力但57.2%延迟;批量增至32时,算力占比升至13.5%,吞吐达约100样本/秒。Cosmos3始终以生成为主,批量从1增至16仅提升14.3%吞吐。我们进一步提出控制时间屋顶图(control-time Roofline),区分推理瓶颈与环境瓶颈:四个LIBERO任务集上pi0.5为环境瓶颈,而Cosmos3保持推理瓶颈。代码与基准测试:https://github.com/mingti-org/phyai。

原文摘要 · Abstract (English)

Physical AI policies require inference throughout their lifecycle, including model evaluation, cloud reinforcement learning rollout, edge GPU serving, and onboard deployment. Although these settings share the same checkpoint and action semantics, they often rely on separate inference programs. To unify them, we build PhyAI, a Physical AI inference engine with a single runtime that keeps architecture-specific conditioning, solver, cache, and output logic in model adapters while sharing graph execution, kernels, memory management, and parallel services. The same codebase runs vision-language-action (VLA) models and world-action models (WAMs) on single or multiple GPUs across onboard, edge, and cloud deployments. We used the adapter interface to add MiniCPM-Robot on the day of its release. PhyAI achieves 1.40x-4.65x speedups over the official implementations of pi0, pi0.5, GR00T N1.7, and MiniCPM-Robot. On Cosmos3-Nano-Policy-DROID it reduces latency from 2.46 to 1.18 s on eight H20 GPUs (CFG=2, TP=4), a 2.08x speedup. Specialized runtimes remain faster in several configurations, so our goal is one runtime with competitive latency rather than the fastest result in every case. Detailed profiles reveal why different models need different execution policies: on a Hopper-series GPU at batch size one, the pi0.5 action expert accounts for 8.8% of FLOPs but 57.2% of latency; at batch size 32 its share drops to 13.5% and throughput reaches about 100 samples/s. Cosmos3 remains generation-dominated and gains only 14.3% throughput as batch size increases from 1 to 16. We further introduce the control-time Roofline, which distinguishes inference-bound from environment-bound control; the measured pi0.5 points on four LIBERO suites are environment-bound while Cosmos3 stays inference-bound. Code and benchmarks: https://github.com/mingti-org/phyai.

物理AI推理引擎机器人边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。