设计智能巡逻策略,让机器人对抗随机攻击更有效。
Patrol Security Game: Defending Against Adversary with Freedom in Attack Timing, Location, and Duration
- 将巡逻问题转化为可求解的极小极大优化问题。
- 在高惩罚场景下,增加巡逻随机性能降低攻击收益。
- 提出多种算法平衡效率与安全性,适合真实安防场景。
我们研究了巡逻安全博弈(Patrol Security Game, PSG),这是一个以扩展型斯坦伯格博弈建模的机器人巡逻问题,其中攻击者可自主选择攻击时间、位置和持续时长。目标是设计一个无限时间范围内的巡逻调度方案,使攻击者收益最小化。我们证明了 PSG 可转化为具有闭式目标函数的组合极小极大问题。当防御方策略被限制为一阶时间齐次马尔可夫链(即巡逻路径仅依赖当前位置)时,零惩罚情形下的最优解等价于最小化期望命中时间或返回时间,且可高效计算。此外,在高惩罚情况下,增加巡逻随机性可降低攻击者期望收益。然而,其他情形下该极小极大问题非凸。为此,我们构建了一个双目标优化问题,兼顾期望最大收益与巡逻路径熵。提出了三种基于图的算法与一种深度强化学习模型,以高效权衡两者。值得注意的是,第三种算法可找到最优确定性巡逻路径,但其运行时间随巡逻点数呈指数增长。实验结果验证了所提方法的有效性与可扩展性,在合成数据集与真实犯罪数据集上均优于现有基线。
原文摘要 · Abstract (English)
We explored the Patrol Security Game (PSG), a robotic patrolling problem modeled as an extensive-form Stackelberg game, where the attacker determines the timing, location, and duration of their attack. Our objective is to devise a patrolling schedule with an infinite time horizon that minimizes the attacker's payoff. We demonstrated that PSG can be transformed into a combinatorial minimax problem with a closed-form objective function. By constraining the defender's strategy to a time-homogeneous first-order Markov chain (i.e., the patroller's next move depends solely on their current location), we proved that the optimal solution in cases of zero penalty involves either minimizing the expected hitting time or return time, depending on the attacker model, and that these solutions can be computed efficiently. Additionally, we observed that increasing the randomness in the patrol schedule reduces the attacker's expected payoff in high-penalty cases. However, the minimax problem becomes non-convex in other scenarios. To address this, we formulated a bi-criteria optimization problem incorporating two objectives: expected maximum reward and entropy. We proposed three graph-based algorithms and one deep reinforcement learning model, designed to efficiently balance the trade-off between these two objectives. Notably, the third algorithm can identify the optimal deterministic patrol schedule, though its runtime grows exponentially with the number of patrol spots. Experimental results validate the effectiveness and scalability of our solutions, demonstrating that our approaches outperform state-of-the-art baselines on both synthetic and real-world crime datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。