用流匹配直接生成驾驶控制轨迹,实时稳定应对未知场景。
Learning Direct Control Policies with Flow Matching for Autonomous Driving

- 基于鸟瞰图输入,通过流匹配直接输出加速度与曲率控制序列。
- 仅需少量常微分方程积分步骤,实现低延迟推理,支持实时重规划。
- 在未见城市和高速场景中表现稳定,适合真实自动驾驶部署。
我们提出一种基于流匹配的自动驾驶规划器,直接输出由加速度和曲率构成的可执行控制轨迹。模型以鸟瞰图(BEV)栅格为输入,通过少量常微分方程(ODE)积分步骤生成控制序列,实现低延迟推理,适用于实时闭环重规划。训练仅使用意大利帕尔马市的2D交通模拟器采集的城市场景数据(包括街道、交叉口和环岛),并在闭环测试中评估其在分布内及显著分布外环境下的表现,涵盖多车道高速公路和未见城市场景。结果表明,模型能可靠泛化至未见条件,保持稳定的闭环控制并成功完成与训练分布差异较大的任务。这归因于BEV表示提供的几何中心视角对分布偏移不敏感,以及流匹配框架学习到的平滑向量场在分布偏移下仍能优雅退化。视频演示详见:https://marcelloceresini.github.io/DirectControlFlowMatching。
原文摘要 · Abstract (English)
We present a flow-matching planner for autonomous driving that directly outputs actionable control trajectories defined by acceleration and curvature profiles. The model is conditioned on a bird's-eye-view (BEV) raster of the surrounding scene and generates control sequences in a small number of Ordinary Differential Equations (ODE) integration steps, enabling low-latency inference suitable for real-time closed-loop re-planning. We train exclusively on urban scenarios (real urban city streets, intersections and roundabouts of the city of Parma, Italy) collected from a 2D traffic simulator with reactive agents, and evaluate in closed-loop on both in-distribution and markedly out-of-distribution environments, including multi-lane highways and unseen urban scenarios. Our results show that the model generalizes reliably to these unseen conditions, maintaining stable closed-loop control and successfully completing scenarios that differ substantially from the training distribution. We attribute this to the BEV representation, which provides a geometry-centric view of the scene that is inherently less sensitive to distributional shifts, and to the flow-matching formulation, which learns a smooth vector field that degrades gracefully under distribution shift. We provide video demonstrations of closed-loop behavior at https://marcelloceresini.github.io/DirectControlFlowMatching.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。