用图神经网络加安全屏障,让机器人在复杂环境中安全高效探索
A Graph-Based Reinforcement Learning Approach with Frontier Potential Based Reward for Safe Cluttered Environment Exploration
- 用图神经网络+强化学习生成探索策略
- 安全屏障干预无效动作,减少碰撞风险
- 结合未知区域距离与信息增益设计奖励函数
自主探索杂乱环境需要高效且安全的探索策略,以避免与未知随机障碍物发生碰撞。本文提出一种新方法,将基于图神经网络的探索贪婪策略与安全屏障结合,确保导航目标选择的安全性。网络通过强化学习和近端策略优化算法训练,旨在最大化探索效率并减少安全屏障的干预次数。若策略选择不可行动作,安全屏障将介入并选取最可行的替代方案,保证系统一致性。此外,本文设计了一种包含潜在场奖励的函数,该场基于智能体与未探索区域的距离及其到达后预期的信息增益。实验表明,该方法在模拟环境中实现了高效且安全的杂乱环境探索。
原文摘要 · Abstract (English)
Autonomous exploration of cluttered environments requires efficient exploration strategies that guarantee safety against potential collisions with unknown random obstacles. This paper presents a novel approach combining a graph neural network-based exploration greedy policy with a safety shield to ensure safe navigation goal selection. The network is trained using reinforcement learning and the proximal policy optimization algorithm to maximize exploration efficiency while reducing the safety shield interventions. However, if the policy selects an infeasible action, the safety shield intervenes to choose the best feasible alternative, ensuring system consistency. Moreover, this paper proposes a reward function that includes a potential field based on the agent's proximity to unexplored regions and the expected information gain from reaching them. Overall, the approach investigated in this paper merges the benefits of the adaptability of reinforcement learning-driven exploration policies and the guarantee ensured by explicit safety mechanisms. Extensive evaluations in simulated environments demonstrate that the approach enables efficient and safe exploration in cluttered environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。