用对抗演化框架实现自动驾驶路径的迭代优化,摆脱单一奖励陷阱。
EvaDrive: Evolutionary Adversarial Policy Optimization for End-to-End Autonomous Driving
- 构建生成与评估闭环对抗博弈,实现路径的多轮迭代改进。
- 在NAVSIM上达94.9 PDMS,优于DiffusionDrive等主流方法。
- 无需外部偏好数据,动态调整权重生成多样驾驶风格。
自动驾驶面临人类级迭代决策的挑战,需持续生成、评估并优化路径提案。现有生成-评估框架将路径生成与评价分离,阻碍规划中的迭代优化;强化学习方法将多维偏好压缩为标量奖励,引入标量偏差。为此,我们提出EvaDrive,一种新型多目标强化学习框架,通过对抗优化建立路径生成与评估之间的真正闭环协同进化。将路径规划视为多轮对抗游戏:分层生成器结合自回归意图建模与扩散模型精修,生成候选路径;可训练的多目标评判器显式保留多样化偏好结构,避免标量简化。该对抗交互由帕累托前沿选择机制引导,支持多轮迭代优化,有效跳出局部最优并保持路径多样性。在NAVSIM与Bench2Drive基准上实验证明,EvaDrive表现领先:于NAVSIM v1取得94.9 PDMS(超越DiffusionDrive 6.8,DriveSuprim 5.0,TrajHF 0.9),Bench2Drive得64.96 Driving Score。无需外部偏好数据,通过动态加权生成多样驾驶风格,提出一种无标量化的轨迹优化新范式。
原文摘要 · Abstract (English)
Autonomous driving faces significant challenges in achieving human-like iterative decision-making, which continuously generates, evaluates, and refines trajectory proposals. Current generation-evaluation frameworks isolate trajectory generation from quality assessment, preventing iterative refinement essential for planning, while reinforcement learning methods collapse multi-dimensional preferences into scalar rewards, obscuring critical trade-offs and yielding scalarization bias.To overcome these issues, we present EvaDrive, a novel multi-objective reinforcement learning framework that establishes genuine closed-loop co-evolution between trajectory generation and evaluation via adversarial optimization. EvaDrive frames trajectory planning as a multi-round adversarial game. In this game, a hierarchical generator continuously proposes candidate paths by combining autoregressive intent modeling for temporal causality with diffusion-based refinement for spatial flexibility. These proposals are then rigorously assessed by a trainable multi-objective critic that explicitly preserves diverse preference structures without collapsing them into a single scalarization bias.This adversarial interplay, guided by a Pareto frontier selection mechanism, enables iterative multi-round refinement, effectively escaping local optima while preserving trajectory diversity.Extensive experiments on NAVSIM and Bench2Drive benchmarks demonstrate SOTA performance, achieving 94.9 PDMS on NAVSIM v1 (surpassing DiffusionDrive by 6.8, DriveSuprim by 5.0, and TrajHF by 0.9) and 64.96 Driving Score on Bench2Drive. EvaDrive generates diverse driving styles via dynamic weighting without external preference data, introducing a closed-loop adversarial framework for human-like iterative decision-making, offering a novel scalarization-free trajectory optimization approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。