提出驾驶场景与车辆运动交互建模新方法,提升自动驾驶理解与规划能力
FlowAD: Ego-Scene Interactive Modeling for Autonomous Driving
- 将车辆运动反馈融入场景流建模,用相对位移表示交互关系
- 在nuScenes上碰撞率降19%,规划前感知帧数提升60%(1.39帧)
- 适用于感知、端到端规划等多任务,适合自动驾驶系统研发者
有效的环境建模是自动驾驶的基础,支撑感知到规划的全流程。然而现有方法常忽略车辆自身运动对观测的影响,导致对驾驶过程理解不完整,限制了规划能力。为此,本文提出一种新的车辆-场景交互建模范式,受人类认知启发,将车辆与场景的交互抽象为相对于自车的场景流。该范式可在特征学习框架内建模车辆运动反馈,充分利用已有日志回放数据,无需依赖场景仿真。我们进一步提出FlowAD——一个通用的基于流的自动驾驶建模框架:首先通过自车引导的场景分割构建基本流单元,其划分由车辆前进方向和转向速度决定,体现自车运动;随后基于流单元进行时空流预测,建模场景流的空间位移与时间变化;最后通过任务感知增强,利用学习到的时空流动态,以对象和区域级策略支持多样化任务。我们还提出新颖的“规划前帧数”(FCP)评估指标,衡量场景理解能力。开放与闭环实验表明,FlowAD在感知、端到端规划及视觉语言模型分析中均具普适性与有效性。显著地,在nuScenes上相比SparseDrive碰撞率降低19%,FCP提升1.39帧(60%),在Bench2Drive上取得51.77的优异驾驶得分,验证了方法优势。代码、模型与配置将公开。
原文摘要 · Abstract (English)
Effective environment modeling is the foundation for autonomous driving, underpinning tasks from perception to planning. However, current paradigms often inadequately consider the feedback of ego motion to the observation, which leads to an incomplete understanding of the driving process and consequently limits the planning capability. To address this issue, we introduce a novel ego-scene interactive modeling paradigm. Inspired by human recognition, the paradigm represents ego-scene interaction as the scene flow relative to the ego-vehicle. This conceptualization allows for modeling ego-motion feedback within a feature learning pattern, advantageously utilizing existing log-replay datasets rather than relying on scenario simulations. We specifically propose FlowAD, a general flow-based framework for autonomous driving. Within it, an ego-guided scene partition first constructs basic flow units to quantify scene flow. The ego-vehicle's forward direction and steering velocity directly shape the partition, which reflects ego motion. Then, based on flow units, spatial and temporal flow predictions are performed to model dynamics of scene flow, encompassing both spatial displacement and temporal variation. The final task-aware enhancement exploits learned spatio-temporal flow dynamics to benefit diverse tasks through object and region-level strategies. We also propose a novel Frames before Correct Planning (FCP) metric to assess the scene understanding capability. Experiments in both open and closed-loop evaluations demonstrate FlowAD's generality and effectiveness across perception, end-to-end planning, and VLM analysis. Notably, FlowAD reduces 19% collision rate over SparseDrive with FCP improvements of 1.39 frames (60%) on nuScenes, and achieves an impressive driving score of 51.77 on Bench2Drive, proving the superiority. Code, model, and configurations will be released here.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。