arXiv:2606.01624cs.CVcs.SE2026-06

提出可解释的测试推荐方法,发现自动驾驶视觉语言模型的盲区。

What to Test Next: Interpretable Coverage Gap Discovery in Driving VLMs

论文配图:What to Test Next: Interpretable Coverage Gap Discovery in Driving VLMs
图 1 · 摘自论文原文
  • 基于暴露度和邻近失败风险,确定性评分推荐缺失测试片段。
  • 在3个驾驶VLM上验证,比现有方法更有效发现高风险盲区。
  • 适合安全关键系统验证,流程可解释、可审计,支持开发者自然语言指令。

自动驾驶视觉语言模型(VLM)需在多样运行设计域(ODD)条件下准确理解场景,但验证仍不充分:许多测试片段缺失,导致实测失效率不可靠。本文提出SliceScorer,一种确定性评分规则,用于推荐缺失片段,结合(i)基于暴露度的覆盖率先验,优先关注罕见未测试区域;(ii)邻近失败先验,将相似已测条件的风险传播至相邻区域。SliceScorer设计简洁,具备可解释、可审计、保守等特性,适用于安全关键验证。针对超出声明ODD的应力测试,我们构建SliceNav——一个由大模型协调的验证流水线,模型解析开发者查询,自动选择相关操作(分诊、评分、采集、评估)与词汇扩展,组合出可追溯的验证流程,同时保持评分确定性与可审计性。在三个驾驶VLM(WiseAD、DriveMM、Cosmos-Reason2-2B)上的实验表明,SliceNav比现有方法更有效地识别高风险覆盖盲区,且推荐覆盖条件空间多样性更高。消融实验确认两个评分组件均贡献显著,定性分析展示了从开发者提问到目标评估的端到端工作流。

原文摘要 · Abstract (English)

Driving vision-language models (VLMs) must accurately understand scenes across diverse conditions defined by Operational Design Domains (ODDs), yet verification remains sparse: many slices are missing, making empirical failure rates unreliable. We propose SliceScorer, a deterministic scoring rule for missing-slice recommendation that combines (i) an exposure-based coverage prior to prioritize rare, under-tested regions, and (ii) a neighbor-failure prior that propagates risk from similar tested conditions. SliceScorer is deliberately simple - interpretable, auditable, and conservative - properties essential for safety-critical validation. For stress testing beyond the declared ODD, we embed SliceScorer within SliceNav, an LLM-orchestrated verification pipeline where the model interprets developer queries to select relevant operators (triage, scoring, acquisition, evaluation) and vocabulary extensions, composing verification workflows while keeping all scoring deterministic and auditable. Experiments on three driving VLMs (WiseAD, DriveMM, Cosmos-Reason2-2B) show that SliceNav surfaces high-risk coverage gaps more effectively than prior slice-discovery methods while maintaining diverse recommendations across the condition space. Ablations confirm both scoring components contribute, and qualitative analysis demonstrates end-to-end workflows from developer query to targeted evaluation.

自动驾驶视觉语言模型测试推荐可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。