arXiv:2509.20102cs.AIcs.RO2025-09被引 7

让自动驾驶测试场景按需调整,实时控制攻击性与真实性的平衡。

Steerable Adversarial Scenario Generation through Test-Time Preference Alignment

  • 通过分层偏好优化,离线学习对抗与真实的权衡策略。
  • 推理时线性插值专家模型权重,实现无重训练的灵活控制。
  • 适合需要定制化测试场景的自动驾驶安全评估团队。

对抗性场景生成是一种高效的安全评估方法,但现有方法通常受限于固定的对抗性与真实性权衡,导致行为特定模型无法在推理时调整,缺乏灵活性和效率。为此,本文将对抗性场景生成重新建模为多目标偏好对齐问题,提出可调控的对抗性场景生成框架SAGE。SAGE采用分层分组偏好优化,离线学习如何解耦硬性约束与软性偏好,以数据高效方式平衡冲突目标。不同于固定模型训练,SAGE在两个相反偏好专家上进行微调,并在推理时通过线性插值其权重构建连续策略谱。理论分析基于线性模式连通性支持该方法。大量实验表明,SAGE不仅生成更具对抗性与真实性的场景,还显著提升驾驶策略的闭环训练效果。项目页面:https://tongnie.github.io/SAGE/。

原文摘要 · Abstract (English)

Adversarial scenario generation is a cost-effective approach for safety assessment of autonomous driving systems. However, existing methods are often constrained to a single, fixed trade-off between competing objectives such as adversariality and realism. This yields behavior-specific models that cannot be steered at inference time, lacking the efficiency and flexibility to generate tailored scenarios for diverse training and testing requirements. In view of this, we reframe the task of adversarial scenario generation as a multi-objective preference alignment problem and introduce a new framework named \textbf{S}teerable \textbf{A}dversarial scenario \textbf{GE}nerator (SAGE). SAGE enables fine-grained test-time control over the trade-off between adversariality and realism without any retraining. We first propose hierarchical group-based preference optimization, a data-efficient offline alignment method that learns to balance competing objectives by decoupling hard feasibility constraints from soft preferences. Instead of training a fixed model, SAGE fine-tunes two experts on opposing preferences and constructs a continuous spectrum of policies at inference time by linearly interpolating their weights. We provide theoretical justification for this framework through the lens of linear mode connectivity. Extensive experiments demonstrate that SAGE not only generates scenarios with a superior balance of adversariality and realism but also enables more effective closed-loop training of driving policies. Project page: https://tongnie.github.io/SAGE/.

自动驾驶对抗生成偏好对齐可控生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。