arXiv:2608.10025cs.ROcs.SE2026-08

低精度运行数据会误导自动驾驶软件可靠性评估,导致乐观误判。

The Impact of Operational-Data Fidelity when Assessing Safety-Critical Autonomous-Vehicle Software

论文配图:The Impact of Operational-Data Fidelity when Assessing Safety-Critical Autonomous-Vehicle Software
图 1 · 摘自论文原文
  • 用改进的贝叶斯方法分析数据细节不足对可靠性评估的影响
  • 发现粗粒度数据使评估结果可能过度乐观,风险被低估
  • 适合从事自动驾驶安全评估与验证的研究者参考

对于关键安全软件,其过往运行数据(如成功与失败事件序列)可为可靠性声明提供有力统计支持。然而,这些数据可能未能充分描述过去软件故障的细节,导致基于此类数据的可靠性评估无法反映故障的关键特征。本文通过扩展保守贝叶斯推断(CBI)技术,提出一种系统性方法,用于检验基于不充分详细运行数据所得可靠性声明的稳健性。我们在自动驾驶(AV)安全评估场景中展示了运行数据细节不足如何削弱可靠性声明。即使评估者已尽力保守使用数据,基于细粒度不足数据得出的可靠性结论仍可能严重高估,存在安全隐患。尽管该现象与以往关于贝叶斯可靠性评估中模型保真度影响的研究一致,但本工作首次澄清了为何以低保真度数据‘保守’处理仍是盲目的,并给出了数据保真度对评估影响的首个保守估计。

原文摘要 · Abstract (English)

For safety-critical software, data from the software's operational past (e.g. a sequence of success and failure events experienced by the software) can provide strong statistical support for reliability claims about the software. However, such data might not describe past software failure events in sufficient detail, and this might leave a reliability assessment (based on this data) unable to account for important features of past software failures. In this paper, by extending conservative Bayesian inference (CBI) techniques used in reliability assessment, we illustrate a principled statistical approach for checking the robustness of reliability claims derived from insufficiently detailed operational data. We demonstrate the extent to which insufficient detail in operational data can undermine software reliability claims in autonomous vehicle (AV) safety assessment scenarios. Reliability claims derived from insufficiently fine-grained data might be dangerously optimistic, despite a concerted effort by an assessor to use such data conservatively during the assessment. While these findings are consistent with previous work on the impact of statistical model fidelity in Bayesian software reliability assessments, our work clarifies why attempts to use low-fidelity data conservatively can be naive, and we give the first conservative estimates of the impact of data fidelity on assessments.

自动驾驶可靠性评估贝叶斯方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。