通过场景增广提升机器人在未知环境中的导航泛化能力。
Enhancing Deep Reinforcement Learning-based Robot Navigation Generalization through Scenario Augmentation
- 将观测映射到虚拟空间生成动作,再映射回真实动作执行。
- 在未见过环境中显著减少导航时间,接近最优轨迹。
- 适合希望提升强化学习导航鲁棒性的研究者与工程师。
本研究聚焦于提升基于深度强化学习的机器人导航在未知环境中的泛化性能。提出一种名为场景增广的新数据增强方法,使机器人无需改变训练场景即可适应多样化环境。该方法通过将机器人的观测映射至想象空间,基于此变换后的观测生成想象动作,并将其重新映射回真实动作在仿真中执行。通过大量对比实验,探究了未知环境中导航表现不佳的根本原因。分析表明,训练场景有限是导致不良行为的主要因素。实验结果证实,场景增广显著提升了深度强化学习导航系统的泛化能力。改进的导航框架在真实应用中展现出卓越性能,生成接近最优的轨迹并大幅缩短导航时间。
原文摘要 · Abstract (English)
This work focuses on enhancing the generalization performance of deep reinforcement learning-based robot navigation in unseen environments. We present a novel data augmentation approach called scenario augmentation, which enables robots to navigate effectively across diverse settings without altering the training scenario. The method operates by mapping the robot's observation into an imagined space, generating an imagined action based on this transformed observation, and then remapping this action back to the real action executed in simulation. Through scenario augmentation, we conduct extensive comparative experiments to investigate the underlying causes of suboptimal navigation behaviors in unseen environments. Our analysis indicates that limited training scenarios represent the primary factor behind these undesired behaviors. Experimental results confirm that scenario augmentation substantially enhances the generalization capabilities of deep reinforcement learning-based navigation systems. The improved navigation framework demonstrates exceptional performance by producing near-optimal trajectories with significantly reduced navigation time in real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。