通过规划状态反馈实现自动驾驶模型在线进化,提升复杂场景适应能力。
EvoPSF: Online Evolution of Autonomous Driving Models via Planning-State Feedback
- 用规划不确定性触发模型更新,精准定位导致失败的关键目标
- 基于感知与预测结果差异计算针对性损失,实现在线自监督优化
- 在nuScenes跨区域和受损数据上显著提升规划稳定性与精度
近年来自动驾驶系统从模块化流程发展为端到端架构,但多数方法仍采用离线训练,部署后无法适应新环境,导致泛化能力下降。本文提出EvoPSF框架,突破“一次训练、长期部署”范式,基于规划状态反馈实现在线进化。我们发现规划失败主要源于物体运动预测不准,且常表现为规划器不确定性升高。因此,将规划不确定性作为触发信号,启动模型更新。通过分析规划器的注意力机制,识别出对决策影响最大的关键物体,并利用感知模块中高置信度输出,对比其真实未来位置与预测路径,计算针对性自监督损失,反向传播以在线优化模型。该方法显著增强模型对环境变化的鲁棒性,提升运动预测精度,从而实现更准确稳定的规划行为。在nuScenes数据集的跨区域及损坏变体实验中,EvoPSF均持续提升规划性能。
原文摘要 · Abstract (English)
Recent years have witnessed remarkable progress in autonomous driving, with systems evolving from modular pipelines to end-to-end architectures. However, most existing methods are trained offline and lack mechanisms to adapt to new environments during deployment. As a result, their generalization ability diminishes when faced with unseen variations in real-world driving scenarios. In this paper, we break away from the conventional "train once, deploy forever" paradigm and propose EvoPSF, a novel online Evolution framework for autonomous driving based on Planning-State Feedback. We argue that planning failures are primarily caused by inaccurate object-level motion predictions, and such failures are often reflected in the form of increased planner uncertainty. To address this, we treat planner uncertainty as a trigger for online evolution, using it as a diagnostic signal to initiate targeted model updates. Rather than performing blind updates, we leverage the planner's agent-agent attention to identify the specific objects that the ego vehicle attends to most, which are primarily responsible for the planning failures. For these critical objects, we compute a targeted self-supervised loss by comparing their predicted waypoints from the prediction module with their actual future positions, selected from the perception module's outputs with high confidence scores. This loss is then backpropagated to adapt the model online. As a result, our method improves the model's robustness to environmental changes, leads to more precise motion predictions, and therefore enables more accurate and stable planning behaviors. Experiments on both cross-region and corrupted variants of the nuScenes dataset demonstrate that EvoPSF consistently improves planning performance under challenging conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。