用机器人领路+强化学习,高效指挥人群疏散。
An effective control of large systems of active particles: An application to evacuation problem
- 以机器人作为领导者,结合强化学习与人工力场控制
- 相比传统强化学习,疏散效率提升显著且更稳定
- 适合需要大规模人群管理的应急场景
大规模主动粒子系统的调控在人群管理、机器人集群控制和协同运输等领域面临挑战,现有方法因缺乏可扩展性和鲁棒性而受限,尤其依赖对每个个体的独立控制。本文提出一种通过领导者的控制策略,将强化学习(RL)与作用于系统的人工力场相结合。为描述领导者对主动粒子的引导,引入广义维茨克模型(generalized Vicsek model)。该方法被应用于机器人救援者(领导者)高效疏散大型人群的场景。实验表明,直接使用强化学习即使采用先进架构仍表现不佳,而本方法则实现了稳健高效的疏散策略。研究代码已公开:https://github.com/cinemere/evacuation。
原文摘要 · Abstract (English)
Manipulation of large systems of active particles is a serious challenge across diverse domains, including crowd management, control of robotic swarms, and coordinated material transport. The development of advanced control strategies for complex scenarios is hindered, however, by the lack of scalability and robustness of the existing methods, in particular, due to the need of an individual control for each agent. One possible solution involves controlling a system through a leader or a group of leaders, which other agents tend to follow. Using such an approach we develop an effective control strategy for a leader, combining reinforcement learning (RL) with artificial forces acting on the system. To describe the guidance of active particles by a leader we introduce the generalized Vicsek model. This novel method is then applied to the problem of the effective evacuation by a robot-rescuer (leader) of large groups of people from hazardous places. We demonstrate, that while a straightforward application of RL yields suboptimal results, even for advanced architectures, our approach provides a robust and efficient evacuation strategy. The source code supporting this study is publicly available at: https://github.com/cinemere/evacuation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。