arXiv:2604.03497cs.ROcs.AI2026-04被引 1

将仿真训练的视觉语言模型强化学习策略零样本部署到真实汽车,实现无需实车训练的自动驾驶。

Sim2Real-AD: A Modular Sim-to-Real Framework for Deploying VLM-Guided Reinforcement Learning in Real-World Autonomous Driving

  • 通过感知与动作映射桥接仿真与现实差异,实现零样本迁移。
  • 在真实电动福特E-Transit车上成功完成跟车、避障、停驶等任务。
  • 框架可推广至其他基于大模型的仿真训练策略,助力电动交通智能化。

视觉语言模型(VLM)引导的强化学习(RL)因用语义信号替代脆弱的手工奖励而备受关注;然而,将此类仿真训练的策略部署到真实车辆仍面临根本挑战,因其依赖仿真器特有的观测和动作语义,在物理硬件上无对应实现。我们识别出一个通用原则:仿真到现实的差距可分解为两个基本正交维度——感知与动力学域差距,以及任务与几何差距。前者可在不进行真实世界策略训练的前提下,通过将真实感知与控制重新投影到策略训练流形上加以弥补。我们形式化这一思想为一项转移保证,其以三个独立可控的误差项界定部署差距,并据此构建了Sim2Real-AD框架,包含几何观测桥接、物理感知动作映射、两阶段渐进式训练流程及实时部署管道。作为概念验证,一辆在CARLA中训练的VLM引导强化学习策略被零样本迁移至美国威斯康星州麦迪逊市的一辆全尺寸电动福特E-Transit货车,在未使用任何真实世界训练数据的情况下,成功执行了跟车、障碍物避让与停车标志响应等场景。据我们所知,这是首个零样本闭环部署于全尺寸真实车辆的CARLA训练的VLM引导强化学习策略,其分解方法为将仿真训练、基础模型引导的策略迁移到物理世界提供了原则性且广泛适用的路径,支持电气化交通平台的能效型智能驾驶。演示视频、代码与模型检查点见:https://zilin-huang.github.io/Sim2Real-AD-website/。

原文摘要 · Abstract (English)

Vision-language-model (VLM)-guided reinforcement learning (RL) has recently attracted significant attention for it, replacing brittle hand-crafted rewards with semantically grounded signals; however, deploying such simulation-trained policies on real vehicles remains a fundamental challenge, because they rely on simulator-native observations and simulator-coupled action semantics with no counterpart on physical hardware. We identify a general principle: the simulation-to-reality gap decomposes into two largely orthogonal axes, a sensing-and-dynamics domain gap and a task-and-geometry gap, the former closable without real-world policy training by re-projecting real perception and control onto the policy's training manifold. We formalize this as a transfer guarantee that bounds the deployment gap by three independently controllable error terms, and instantiate it as Sim2Real-AD, which combines a Geometric Observation Bridge, a Physics-Aware Action Mapping, a Two-Phase Progressive Training curriculum, and a Real-time Deployment Pipeline. As a proof of concept, a CARLA-trained VLM-guided RL policy is transferred zero-shot to a full-scale battery-electric Ford E-Transit van in Madison, WI, USA, and drives across car-following, obstacle-avoidance, and stop-sign scenarios using no real-world training data. To our knowledge, this is among the first zero-shot closed-loop deployments of a CARLA-trained VLM-guided RL policy on a full-scale real vehicle, and the decomposition offers a principled, broadly applicable route for moving simulation-trained, foundation-model-guided policies into the physical world, supporting energy-efficient intelligent driving on electrified transportation platforms. The demo video, code, and model checkpoint are available at: https://zilin-huang.github.io/Sim2Real-AD-website/.

自动驾驶强化学习仿真迁移视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。