基于策略优化的可扩展动态导航模型,解决多机器人足球队碰撞问题
Towards Learning Scalable Agile Dynamic Motion Planning for Robosoccer Teams with Policy Optimization
- 采用策略优化学习动态路径规划,适应快速变化环境
- 在多机器人足球场景中实现无碰撞高效导航,支持异构团队
- 突破传统方法计算瓶颈,适合高并发、实时性要求场景
在快节奏、不断变化的环境中,多智能体系统在存在障碍物情况下的动态运动规划是一个普遍且未解决的问题。无论是绕过障碍物的路径规划,还是机械臂运动,或是在机器人团队(如机器人足球)中的导航规划,都需要在多个智能体共用同一区域时避免碰撞并到达目标位置。在连续域中世界快速变化的情况下,现有经典运动规划算法(如RRT*和A*)在每个时间步重新运行变得计算成本过高。尽管已有大量经典与良好形式化的非学习路径规划方法被提出以解决此问题,但受限于速度、平滑性、最优性等,仍难以满足需求。深度学习模型因能根据过往经验适应不同环境而克服了这些挑战。然而,当前学习型运动规划模型使用离散化环境,未考虑异构智能体或重规划问题,且仅旨在提升经典规划器效率,导致可扩展性不足。为在异构团队成员间及与障碍物之间避免碰撞的同时抵达目标位置,本文提出一种基于学习的动态导航模型,并在简单机器人足球环境中验证其有效性。
原文摘要 · Abstract (English)
In fast-paced, ever-changing environments, dynamic Motion Planning for Multi-Agent Systems in the presence of obstacles is a universal and unsolved problem. Be it from path planning around obstacles to the movement of robotic arms, or in planning navigation of robot teams in settings such as Robosoccer, dynamic motion planning is needed to avoid collisions while reaching the targeted destination when multiple agents occupy the same area. In continuous domains where the world changes quickly, existing classical Motion Planning algorithms such as RRT* and A* become computationally expensive to rerun at every time step. Many variations of classical and well-formulated non-learning path-planning methods have been proposed to solve this universal problem but fall short due to their limitations of speed, smoothness, optimally, etc. Deep Learning models overcome their challenges due to their ability to adapt to varying environments based on past experience. However, current learning motion planning models use discretized environments, do not account for heterogeneous agents or replanning, and build up to improve the classical motion planners' efficiency, leading to issues with scalability. To prevent collisions between heterogenous team members and collision to obstacles while trying to reach the target location, we present a learning-based dynamic navigation model and show our model working on a simple environment in the concept of a simple Robosoccer Game.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。