arXiv:2411.04653cs.ROcs.LG2024-11被引 4

构建驾驶模仿学习的基准,揭示感知差异导致的性能瓶颈。

IGDrivSim: A Benchmark for the Imitation Gap in Autonomous Driving

  • 基于Waymax仿真器构建模仿差距测试基准
  • 感知差异使模仿学习难以掌握安全驾驶行为
  • 结合强化学习与惩罚奖励可有效缓解该问题

实现具备人类水平安全与效率的自动驾驶是自驾车研究的核心目标。常见方法是模仿学习,即让智能体学习真人专家在真实驾驶场景中提供的示范。然而,人类感知与自动驾驶车辆传感器之间的差异会引入‘模仿差距’,导致模仿学习失败。本文提出IGDrivSim,一个基于Waymax模拟器构建的基准,用于研究从真人示范中学习自动驾驶策略时模仿差距的影响。实验表明,这种感知差异会阻碍安全高效驾驶行为的学习。进一步发现,将模仿学习与强化学习结合,通过简单惩罚违规行为的奖励机制,能有效缓解此类失败。代码已开源:https://github.com/clemgris/IGDrivSim.git。

原文摘要 · Abstract (English)

Developing autonomous vehicles that can navigate complex environments with human-level safety and efficiency is a central goal in self-driving research. A common approach to achieving this is imitation learning, where agents are trained to mimic human expert demonstrations collected from real-world driving scenarios. However, discrepancies between human perception and the self-driving car's sensors can introduce an $\textit{imitation}$ gap, leading to imitation learning failures. In this work, we introduce $\textbf{IGDrivSim}$, a benchmark built on top of the Waymax simulator, designed to investigate the effects of the imitation gap in learning autonomous driving policy from human expert demonstrations. Our experiments show that this perception gap between human experts and self-driving agents can hinder the learning of safe and effective driving behaviors. We further show that combining imitation with reinforcement learning, using a simple penalty reward for prohibited behaviors, effectively mitigates these failures. Our code is open-sourced at: https://github.com/clemgris/IGDrivSim.git.

自动驾驶模仿学习基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。