arXiv:2605.08713cs.ROcs.AI2026-05被引 2

用强化学习+高斯溅射仿真,实现端到端自动泊车,尤其擅长窄车位。

REAP: Reinforcement-Learning End-to-End Autonomous Parking with Gaussian Splatting Simulator for Real2Sim2Real Transfer

论文配图:REAP: Reinforcement-Learning End-to-End Autonomous Parking with Gaussian Splatting Simulator for Real2Sim2Real Transfer
图 1 · 摘自论文原文
  • 基于SAC的异步强化学习框架,结合规则规划行为克隆加速训练。
  • 引入软碰撞惩罚机制,使碰撞率显著降低,实测在窄车位成功率达95%。
  • 通过真实-仿真-真实闭环训练,提升模型在真实场景的直接部署能力。

近年来,自动驾驶泊车取得显著进展,但在机械式、死胡同等极端场景下仍易失败,主要源于传统多阶段方法难以全局优化。端到端方法可联合感知与规划模块,消除误差累积,提升极端场景表现。尽管已有研究采用模仿或强化学习,但前者受限于数据成本与分布覆盖,后者存在探索效率低的问题。为此,我们提出端到端强化学习泊车方法REAP。REAP在非对称强化学习框架中采用Soft Actor-Critic(SAC)提升训练效率与推理性能,并通过行为克隆将规则规划器的能力迁移到端到端网络中以加速收敛。此外,引入软预测碰撞惩罚机制,对靠近障碍物的动作进行惩罚,有效降低碰撞率。为确保模型可直接部署至真实场景,我们构建了Real2Sim2Real仿真系统:在Real2Sim阶段,利用3D高斯溅射(3DGS)将真实场景转化为数字场景;在Sim2Real阶段,将训练好的端到端模型部署至车辆,弥合仿真与现实差距。在3DGS仿真中训练并在真实车辆上测试,REAP成功完成多种类型泊车位的泊车任务,尤其验证了在极窄机械车位中端到端强化学习泊车的可行性。

原文摘要 · Abstract (English)

In recent years, autonomous parking has made significant advances, yet parking tasks still face challenges in extreme scenarios such as mechanical and dead-end parking slots, often resulting in failures. This is mainly due to traditional parking methods adopting a multistage approach, lacking the ability to optimize the parking problem as a whole. End-to-end methods enable joint optimization across perception and planning modules to eliminate the accumulation of errors, enhancing algorithm performance in extreme scenarios. Although several end-to-end parking methods use imitation or reinforcement learning, the former is limited by data cost and distribution coverage, while the latter suffers from inefficient exploration. To address these challenges, we propose a Reinforcement learning End-to-end Autonomous Parking method (REAP). REAP employs Soft Actor-Critic (SAC) within an asymmetric reinforcement learning framework to improve training efficiency and inference performance. To accelerate model convergence, we distill the capabilities of a rule-based planner into the end-to-end network through behavior cloning. We further introduce a soft predictive collision penalty mechanism to reduce collision rates by penalizing obstacle-approaching actions. To ensure that the trained reinforcement learning network can directly transfer to real-world scenarios, we have established a Real2Sim2Real simulator. In the Real2Sim step, we use 3D Gaussian Splatting (3DGS) to transform real-world scenes into digital scenes. In the Sim2Real step, we deploy the end-to-end model onto the vehicle to bridge the Sim2Real gap. Trained in the 3DGS simulator and deployed on physical vehicles, REAP successfully parks in various types of parking spaces, especially demonstrating the feasibility of end-to-end RL parking in extremely narrow mechanical slots.

自动驾驶强化学习端到端仿真迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。