让机器人撞了也能继续试,提升导航训练效率
Do We Really Need Immediate Resets? Rethinking Collision Handling for Efficient Robot Navigation

- 撞了不立刻重来,允许在同一次任务中多次尝试
- 早期训练阶段减少约40%交互次数就达到目标成功率
- 适合想加速机器人导航训练的研究者和工程师
在多数深度强化学习机器人导航框架中,一旦碰撞就立即全局重置环境并视为任务失败。但训练时的碰撞会阻碍智能体探索复杂障碍布局,影响早期学习效率。本文提出多碰撞重试预算(MCB)框架,将局部碰撞终止与全局重置解耦,允许智能体在单个任务中反复尝试困难配置。仿真结果显示,采用小规模碰撞预算可显著提升早期学习效率,用更少交互次数达到目标成功率达90%以上;真实机器人平台实验进一步验证了策略在杂乱环境中的可部署性。
原文摘要 · Abstract (English)
Should a single collision necessarily terminate an entire navigation episode? In most deep reinforcement learning (DRL) frameworks for robot navigation, this remains the standard practice: every collision immediately triggers a global environment reset and is penalized as a complete task failure. While a collision during deployment naturally indicates task failure, applying the same treatment during training prevents the agent from exploring challenging obstacle configurations, which slows learning progress in the early training phase. In this work, we challenge this convention and propose a Multi-Collision reset Budget (MCB) framework that decouples local collision termination from global environment resets, allowing the agent to retry difficult configurations within the same episode. Simulation experiments show that MCB improves early-stage learning efficiency by reaching target success-rate levels with fewer interactions, with small collision budgets producing the most consistent gains. Real-world experiments on heterogeneous robot platforms further validate the deployability of the learned policies in cluttered environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。