动态环境下实时调度多任务推理,保障机器人系统性能与响应时效。
RED: Adaptive Real-Time DAG Scheduling for Robotic Inference under Environmental Dynamics

- 基于截止时间感知的自适应调度器,动态分配子截止时间应对计算图变化。
- 在Jetson和M系列芯片上测试,吞吐量与截止时间满足率显著优于现有方法。
- 专为共享参数的多输入多输出神经网络设计,提升资源利用率与可调度性。
部署于动态环境中的机器人需应对运行时计算需求的变化:新任务可能涌现,依赖关系可能改变,整体工作负载结构持续演进,这些都会导致性能下降,尤其在资源受限且实时性要求高的多任务推理场景下。本文提出RED框架,用于在资源受限的机器人平台上对多任务深度神经网络工作负载进行实时调度,能够适应机器人环境动态(Robotic Environmental Dynamics, RED),并在建模假设下保持端到端时序保证。其核心是一个截止时间感知的调度器,通过分配中间子截止时间,支持动态计算图和不可预测条件下的异步推理。该框架还支持MIMONet(多输入多输出神经网络)的灵活部署,这类模型常通过权值共享缓解内存压力。RED通过工作负载精炼与图重构过程,显式利用其共享参数特性,使模型结构更符合可调度性要求,从而提升兼容性与效率。我们在NVIDIA Jetson系列平台和Apple M系列MacBook上实现并评估了RED,使用面向导航任务的工作负载模拟真实机器人场景。实验表明,在吞吐量、截止时间满足率、抗干扰能力、适应性及运行开销方面,RED均持续优于现有方法。
原文摘要 · Abstract (English)
Robots deployed in dynamic environments must contend with environment-driven changes that reshape computation at runtime: new tasks may appear, precedence relations can shift, and overall workload structure evolves, all of which degrade performance, especially when multi-task inference is required under tight resource and real-time budgets. We present RED, a real-time scheduling framework for multi-task deep neural network workloads on resource-constrained robotic platforms that adapts to Robotic Environmental Dynamics (RED) while preserving end-to-end timing guarantees under modeling assumptions. The core of RED is a deadline-aware scheduler that assigns intermediate sub-deadlines, allowing it to accommodate evolving computation graphs and asynchronous inference induced by unpredictable conditions. The framework also supports flexible deployment of MIMONet (multi-input multi-output neural networks), commonly used in multi-tasking robots to alleviate memory pressure through weight sharing. RED explicitly leverages this shared-parameter property via a workload refinement and graph-reconstruction procedure that aligns MIMONet structure with schedulability requirements, improving compatibility and efficiency. We implement RED on NVIDIA Jetson family platforms and on an Apple M-series MacBook and evaluate it on navigation-oriented workloads representative of real robotic scenarios. Experiments show consistent gains over existing methods in throughput, deadline satisfaction, robustness to interference, adaptability, and runtime overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。