用图注意力网络+安全过滤器,让机器人在复杂环境里又快又安全地探索。
Platform-Agnostic Reinforcement Learning Framework for Safe Exploration of Cluttered Environments with Graph Attention
- 用图神经网络选下一步位置,结合安全过滤器避免碰撞。
- 通过强化学习优化探索效率,减少安全干预次数。
- 适合希望安全部署学习型机器人的研究者和工程师。
自主探索障碍物密集空间需要兼顾效率与安全性。本文提出一种平台无关的强化学习框架,融合基于图神经网络的策略网络与安全过滤器,实现安全移动。策略网络采用近端策略优化(PPO)算法训练,目标是最大化探索效率并最小化安全过滤器的干预次数。当策略提出不可行动作时,安全过滤器会将其替换为最近的可行替代方案,确保系统行为一致。同时,引入基于势场的奖励函数,综合考虑代理距离未探索区域的远近及其预期信息增益。该框架结合了强化学习策略的适应性与显式安全机制的可靠性,显著提升真实场景下学习型策略的部署可行性。在仿真与实验室环境中的大量实验表明,该方法能在复杂环境中实现高效且安全的探索。
原文摘要 · Abstract (English)
Autonomous exploration of obstacle-rich spaces requires strategies that ensure efficiency while guaranteeing safety against collisions with obstacles. This paper investigates a novel platform-agnostic reinforcement learning framework that integrates a graph neural network-based policy for next-waypoint selection, with a safety filter ensuring safe mobility. Specifically, the neural network is trained using reinforcement learning through the Proximal Policy Optimization (PPO) algorithm to maximize exploration efficiency while minimizing safety filter interventions. Henceforth, when the policy proposes an infeasible action, the safety filter overrides it with the closest feasible alternative, ensuring consistent system behavior. In addition, this paper introduces a reward function shaped by a potential field that accounts for both the agent's proximity to unexplored regions and the expected information gain from reaching them. The proposed framework combines the adaptability of reinforcement learning-based exploration policies with the reliability provided by explicit safety mechanisms. This feature plays a key role in enabling the deployment of learning-based policies on robotic platforms operating in real-world environments. Extensive evaluations in both simulations and experiments performed in a lab environment demonstrate that the approach achieves efficient and safe exploration in cluttered spaces.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。