提出新方法优化多机器人监控的最差延迟,提升系统响应能力。
Minimizing Worst-Case Weighted Latency for Multi-Robot Persistent Monitoring: Theory and RL-Based Solutions

- 构建事件驱动的马尔可夫决策模型,将复杂目标转为标准奖励形式
- 通过强化学习求解,在合成与真实场景中显著降低最差加权延迟
- 设计统一评估平台,支持对比传统算法与学习方法
我们研究加权图上的多机器人持续监控问题,其中节点权重表示监控优先级,边权重表示移动距离。目标是设计联合机器人轨迹,使所有节点在无限时间内的最差加权延迟最小化。现有最差延迟指标关注长期表现,可能忽略瞬态行为不佳但渐近性能优异的策略。为此,我们提出一类尾部性能目标,广义化标准目标,并研究其对应的函数优化问题。建立了最优策略存在性、目标间关系、周期解可任意逼近及离散等待时间下的事件驱动模型转化等理论性质。基于此,构造了等价的事件驱动马尔可夫决策过程(TWLO-MDP),将尾部性能目标转化为标准平均奖励准则。进一步开发了基于强化学习的求解方法,并引入多机器人监控基准测试平台(M2Bench),支持启发式与学习型算法的评估与比较。在合成和真实监控场景中的实验表明,所提方法有效降低最差加权延迟,优于代表性基线。
原文摘要 · Abstract (English)
We study multi-robot persistent monitoring on weighted graphs, where node weights encode monitoring priorities and edge weights encode travel distances. The goal is to design joint robot trajectories that minimize the worst-case weighted latency across all nodes over an infinite time horizon. The widely adopted worst-case latency objective evaluates team performance over the entire time horizon and therefore may fail to distinguish strategies with poor transient behavior but strong asymptotic performance. To address this limitation, we propose a family of tail-performance objectives that generalize the standard objective and study the resulting functional optimization problems. We establish several key theoretical properties, including the existence of optimal strategies, relationships among the proposed objectives and their corresponding optimization problems, approximation by periodic solutions to arbitrary accuracy, and reductions to event-driven decision models with discretized waiting times. Building on these results, we construct an equivalent event-driven Markov decision process (MDP), called the Tail Worst-case Latency-Optimizing Markov Decision Process (TWLO-MDP), which reformulates the tail-performance objective as a standard average-reward criterion. We then develop reinforcement-learning-based solution methods for the TWLO-MDP and introduce the multi-robot monitoring benchmark (M2Bench), a unified platform that supports the evaluation and comparison of heuristic and learning-based monitoring algorithms. Experiments on synthetic and realistic monitoring scenarios show that our methods effectively reduce the worst-case weighted latency and outperform representative baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。