arXiv:2606.04149cs.RO2026-06

让自动驾驶车在泊车时既精准又会避让,靠自对弈强化学习实现。

CoPark: Learning Reactive Parking via Self-Play

论文配图:CoPark: Learning Reactive Parking via Self-Play
图 1 · 摘自论文原文
  • 用预设路径加动态修正的双层策略,兼顾泊车精度与避障反应。
  • 在多个停车场测试中成功率70%-85%,碰撞率仅3%-6%。
  • 适合做智能泊车系统研发,尤其关注多车交互场景。

在需要高几何精度到达目标的同时安全交互邻近车辆的任务中,精确性与反应性存在冲突:前者倾向固定路径,后者需即时避让。本文研究自主反应式泊车问题,要求多辆车以亚米级精度停入指定车位,并全程响应邻车动作。提出CoPark,一种基于残差策略架构的多智能体自对弈强化学习方法。预训练离线路径提供固定动作先验,残差头学习动态修正。关键设计是受伙伴威胁调节的通道非对称先验释放:连续威胁信号将纵向控制权转移给残差头以实现让行,横向仍锚定预设参考以保持亚米级对齐。闭环精修层纠正动作网格离散化带来的终端误差。在六个停车场训练,零样本评估于新构建的反应式泊车基准(包含Dragon Lake Parking和DeepScenario Open 3D)。CoPark达成约70%-85%成功率,碰撞率仅3%-6%,显著优于经典方法、模仿学习及大规模RL基线。结果展现反向让行、中途让行、窄道通过、排队等涌现交互行为。

原文摘要 · Abstract (English)

Learning a single policy that reaches a goal with high geometric precision while interacting safely with nearby agents poses conflicting objectives. Precision favors commitment to a fixed geometric plan, whereas interaction requires immediate deviation when another agent intrudes, causing policies optimized for one objective to often fail at the other. We study this problem in the context of reactive autonomous parking, where multiple vehicles must reach assigned slots with sub-meter terminal accuracy while remaining responsive to neighboring vehicles throughout the maneuver. We propose CoPark, a multi-agent self-play RL approach built on a residual-policy architecture. A precomputed offline plan provides a fixed action prior, while a residual head learns the reactive corrections. The residual policy learns behaviors under self-play, where data and scripting fall short, while the fixed prior holds the slot-frame geometry that pure policies struggle to reach reliably. The key design is a partner-threat-modulated, channel-asymmetric release of the prior. A continuous threat signal shifts authority of the longitudinal channel to the residual head to enable yielding, while the lateral channel remains anchored to the precomputed reference to preserve sub-meter slot alignment. A closed-loop refinement layer corrects residual terminal error from action-grid discretization. We train our policy on six parking lots and evaluate zero-shot on our new reactive-parking benchmark spanning Dragon Lake Parking (DLP) and DeepScenario Open 3D (DSC3D). CoPark achieves ~70-85% success with only 3-6% collision rate, substantially outperforming classical, imitation-learning, and large-scale RL baselines. Importantly, the results demonstrate emergent interaction behaviors such as reverse-yielding, mid-maneuver yielding, tight-corridor passing, and queuing.

自动驾驶强化学习泊车系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。