基于策略缺陷诊断生成对抗性驾驶场景,提升自动驾驶系统鲁棒性。
SPHINX: First Explain, Then Explore

- 先分析策略决策过程,识别关键视觉特征与不确定性
- 利用可解释AI提取失败证据,指导生成针对性对抗场景
- 适用于多种主流自动驾驶模型,显著提升系统鲁棒性
生成对抗性驾驶场景对于评估和改进自动驾驶决策系统至关重要。现有方法主要依赖大语言模型和视觉-语言模型的先验知识进行场景程序化生成。我们提出SPHINX,一种闭环框架,遵循‘先解释,后探索’原则:首先通过可解释人工智能方法分析驾驶策略,识别关键视觉概念及其对策略输出的影响以及决策不确定性;基于策略自身决策过程提取的可解释证据,使用视觉语言模型生成对策略失败模式的理性批评;这些批评被用于生成有针对性的对抗性场景,用于策略重训练与改进。实验表明,SPHINX能揭示其他方法无法捕捉的策略失败可解释原因,在多个基准测试中适用于多种先进自动驾驶架构,并持续提升现有场景生成方法的鲁棒性。
原文摘要 · Abstract (English)
Generating adversarial driving scenarios is critical for evaluating and improving autonomous vehicle decision-making systems in simulation. Recent approaches rely primarily on the prior knowledge of Large Language Models and Vision-Language Models to generate driving scenarios procedurally. We argue that adversarial scenes should be generated based on the failure diagnosis (e.g., indecisiveness, multi-frame inconsistency) of the driving policy to specifically address the policy's weaknesses instead of relying on prior assumptions. In this paper, we propose SPHINX, a closed-loop framework for adversarial scenario synthesis guided by a simple principle: first explain, then explore. Beyond blindly exploring the scenario space, SPHINX leverages explainable artificial intelligence methods to analyze the policy, identifying key visual concepts and their influence on policy outputs, and the uncertainty of the decisions. Given the interpretable evidence extracted from the policy's own decision process, we use a vision language model to rationalize and criticize failure modes of the current policy. These critics are then used to generate targeted adversarial scenarios for policy retraining and improvement. We demonstrate that SPHINX can highlight an interpretable account of policy failures while other adversarial scene generation cannot. Across the evaluated benchmarks and test suites, SPHINX can be applied to diverse state-of-the-art autonomous vehicle architectures and yields consistent robustness improvements over existing scenario-generation methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。