让自动驾驶训练更高效安全,自动生成能学得会的挑战场景。
From Attacks to Curricula: Learnability-Guided Adversarial Training for Safe Autonomous Driving

- 将攻击性场景生成转为可解决的课程学习,提升训练有效性。
- 实验显示训练步数减少40.6%,碰撞率降低,路径完成率更高。
- 适合研究自动驾驶安全训练与强化学习优化的学者和工程师。
闭环对抗训练通过暴露策略于罕见的安全关键场景来提升自动驾驶安全性。现有方法通常先生成对抗场景,再采样用于策略优化,但多数仍以攻击为导向:碰撞驱动的生成器常产生无法解决的极端情况,损害学习效果;启发式采样器忽视策略能力的动态演变,导致样本效率低、收敛延迟。本文提出AlignADV,一种可学习性引导的闭环对抗训练框架,将对抗场景转化为可解决且能力对齐的课程。首先,将对抗场景生成重构为偏好对齐问题,采用直接偏好优化引导生成器关注关键但可解的场景;其次,引入行为指纹捕捉策略演化特征,构建多模态能力预测模型,在无需昂贵闭环仿真情况下估计策略性能。结合可解性对齐场景与能力预测,AlignADV设计动态课程采样机制,优先选择针对当前策略脆弱点的场景。在Waymo Open Motion Dataset上的实验表明,AlignADV显著提升收敛效率与最终性能,相比基线方法最多减少40.6%训练步数,同时降低碰撞率并提升正常与对抗交通条件下的路径完成率。结果表明,从攻击导向转向可学习性引导的策略改进,为更安全高效的自动驾驶训练提供了原则性方向。
原文摘要 · Abstract (English)
Closed-loop adversarial training improves autonomous driving safety by exposing policies to rare safety-critical scenarios. Standard pipelines first generate adversarial scenarios and then sample them for policy optimization. However, most existing frameworks remain attack-oriented: collision-driven generators often synthesize unsolvable extreme situations, which can degrade learning, while heuristic samplers ignore the evolving capability of the driving policy, causing sample inefficiency and delayed convergence. We propose AlignADV, a learnability-guided closed-loop adversarial training framework that converts adversarial scenarios into resolvable and capability-aligned curricula. First, we reformulate adversarial scenario generation as a preference alignment problem and employ direct preference optimization to guide the generator toward critical yet resolvable scenarios. Second, we introduce behavioral fingerprints to capture the intrinsic characteristics of the evolving policy and construct a multi-modal capability prediction model that estimates policy performance without expensive closed-loop simulations. By combining resolvability-aligned scenarios with capability predictions, AlignADV develops a dynamic curriculum sampling mechanism that prioritizes scenarios targeting the current policy's vulnerabilities. Experiments on the Waymo Open Motion Dataset demonstrate that AlignADV improves convergence efficiency and final performance, reducing training steps by up to 40.6 percent compared with baseline methods while lowering collision rate and improving route completion under both normal and adversarial traffic conditions. These results highlight a shift from attack-oriented scenario generation to learnability-guided policy improvement, offering a principled direction for safer and more efficient autonomous driving training. Project page: https://meiyuewen.github.io/AlignADV/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。