用强化学习让汽车机器人自动解开狭窄死胡同,比传统方法更高效可靠。
Nonholonomic Narrow Dead-End Escape with Deep Reinforcement Learning
- 设计多阶段正反向轨迹生成器,模拟真实车辆运动约束
- 在真实物理约束下训练策略,解决90%以上狭窄死胡同问题
- 适合自动驾驶、智能导航等需要复杂避障的场景
非完整约束限制了可行速度但不减少配置空间维度,导致大多数几何路径对类车机器人不可执行。阿克曼转向进一步施加曲率限制并禁止原地旋转,因此从狭窄死胡同中脱困通常需要紧密衔接的前进与后退动作序列。传统规划器因全局搜索与局部转向解耦,在此类场景中表现不佳,因为狭窄通道占据低测度区域,且非完整可达性缩小了有效连接集,降低了采样效率并增加对间隙敏感性。本文研究阿克曼车辆在非完整约束下的狭窄死胡同逃脱问题,贡献三个部分:首先构建一个生成器,可生成符合阿克曼运动学的多阶段前后向轨迹,并扩展其包络以合成至少存在一条可行逃生路径的狭窄死胡同家族;其次构建满足运动学约束的训练环境,并使用软演员-评论家算法训练策略;最后在参数化死胡同家族上评估该策略,对比代表性经典规划器(结合全局搜索与非完整转向)。结果表明,所学策略在更高比例实例中成功求解,减少操作次数,同时保持相近路径长度与规划时间,且在相同感知与控制极限下表现更优。项目代码已开源:https://github.com/gitagitty/cisDRL-RobotNav.git。
原文摘要 · Abstract (English)
Nonholonomic constraints restrict feasible velocities without reducing configuration-space dimension, which makes collision-free geometric paths generally non-executable for car-like robots. Ackermann steering further imposes curvature bounds and forbids in-place rotation, so escaping from narrow dead ends typically requires tightly sequenced forward and reverse maneuvers. Classical planners that decouple global search and local steering struggle in these settings because narrow passages occupy low-measure regions and nonholonomic reachability shrinks the set of valid connections, which degrades sampling efficiency and increases sensitivity to clearances. We study nonholonomic narrow dead-end escape for Ackermann vehicles and contribute three components. First, we construct a generator that samples multi-phase forward-reverse trajectories compatible with Ackermann kinematics and inflates their envelopes to synthesize families of narrow dead ends that are guaranteed to admit at least one feasible escape. Second, we construct a training environment that enforces kinematic constraints and train a policy using the soft actor-critic algorithm. Third, we evaluate against representative classical planners that combine global search with nonholonomic steering. Across parameterized dead-end families, the learned policy solves a larger fraction of instances, reduces maneuver count, and maintains comparable path length and planning time while under the same sensing and control limits. We provide our project as open source at https://github.com/gitagitty/cisDRL-RobotNav.git
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。