arXiv:2605.00005cs.LGcs.AI2026-05被引 1

云推理在实时控制中可比本地推理更可靠,关键在于高算力资源的调度优化。

Cloud Is Closer Than It Appears: Revisiting the Tradeoffs of Distributed Real-Time Inference

论文配图:Cloud Is Closer Than It Appears: Revisiting the Tradeoffs of Distributed Real-Time Inference
图 1 · 摘自论文原文
  • 构建分析模型,量化感知频率、网络延迟与平台吞吐对分布式推理时延的影响。
  • 在自动驾驶紧急制动场景下,云推理在95%以上情况下满足安全时延要求,优于本地推理。
  • 适合关注低延迟控制的智能汽车、工业自动化等实时系统设计者参考。

深度神经网络在人机交互系统中的部署提升了感知精度,但对执行平台提出巨大计算压力,威胁实时控制截止时间。传统分布式架构倾向于本地推理以规避远程平台的网络波动和竞争延迟。然而,这种设计给本地硬件带来显著能耗与计算负担。本文重新审视‘云推理不适用于低延迟任务’的假设,证明当具备高吞吐计算资源时,云平台可有效分摊网络与排队延迟,实现与本地推理相当或更优的实时决策性能。我们构建了分布式推理时延的解析模型,其依赖于感知频率、平台吞吐、网络延迟及任务特定安全约束。以自动驾驶紧急制动为例,通过真实车辆动力学仿真验证,结果表明在特定条件下,云推理比本地推理更可靠地满足安全裕度。该发现挑战了现有设计范式,表明云并非遥不可及,反而在多数情况下是更优的推理位置。

原文摘要 · Abstract (English)

The increasing deployment of deep neural networks (DNNs) in cyber-physical systems (CPS) enhances perception fidelity, but imposes substantial computational demands on execution platforms, posing challenges to real-time control deadlines. Traditional distributed CPS architectures typically favor on-device inference to avoid network variability and contention-induced delays on remote platforms. However, this design choice places significant energy and computational demands on the local hardware. In this work, we revisit the assumption that cloud-based inference is intrinsically unsuitable for latency-sensitive control tasks. We demonstrate that, when provisioned with high-throughput compute resources, cloud platforms can effectively amortize network and queueing delays, enabling them to match or surpass on-device performance for real-time decision-making. Specifically, we develop a formal analytical model that characterizes distributed inference latency as a function of the sensing frequency, platform throughput, network delay, and task-specific safety constraints. We instantiate this model in the context of emergency braking for autonomous driving and validate it through extensive simulations using real-time vehicular dynamics. Our empirical results identify concrete conditions under which cloud-based inference adheres to safety margins more reliably than its on-device counterpart. These findings challenge prevailing design strategies and suggest that the cloud is not merely a feasible option, but often the preferred inference location for distributed CPS architectures. In this light, the cloud is not as distant as traditionally perceived; in fact, it is closer than it appears.

边缘计算实时系统自动驾驶云推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。