用贝叶斯等效检验验证仿真事故场景是否真实可靠
Practical Equivalence Testing and Its Application in Synthetic Pre-Crash Scenario Validation
- 基于贝叶斯ROPE框架,判断仿真与真实事故场景是否实质等效
- 在两个追尾事故数据集上验证,证明方法可有效识别关键特征差异
- 适合自动驾驶安全评估人员,提升仿真测试可信度
驾驶自动化系统的安全性评估依赖于具有代表性的事故前场景模拟。然而,当前缺乏对仿真与真实事故场景及其碰撞特征相似性的稳健评估。若无有效验证,无法确保仿真场景能充分反映真实驾驶行为和碰撞特性。传统统计方法如显著性检验关注检测差异而非确认等效性,未能发现差异并不意味着等效,因此难以用于仿真场景验证。本文提出基于贝叶斯实际等效区间(ROPE)框架的等效性检验方法,聚焦评估目标中最重要的场景特征,特别适用于虚拟安全评估领域。我们回顾了现有等效检验方法,并通过两个追尾事故数据集验证了该方法的有效性。分析揭示了等效检验在仿真测试场景验证中的实用性与有效性,强调其对提升仿真数据可信度及后续安全影响评估可靠性的重要性。
原文摘要 · Abstract (English)
The use of representative pre-crash scenarios is critical for assessing the safety impact of driving automation systems through simulation. However, a gap remains in the robust evaluation of the similarity between synthetic and real-world pre-crash scenarios and their crash characteristics. Without proper validation, it cannot be ensured that the synthetic test scenarios adequately represent real-world driving behaviors and crash characteristics. One reason for this validation gap is the lack of focus on methods to confirm that the synthetic test scenarios are practically equivalent to real-world ones, given the assessment scope. Traditional statistical methods, like significance testing, focus on detecting differences rather than establishing equivalence; since failure to detect a difference does not imply equivalence, they are of limited applicability for validating synthetic pre-crash scenarios and crash characteristics. This study addresses this gap by proposing an equivalence testing method based on the Bayesian Region of Practical Equivalence (ROPE) framework. This method is designed to assess the practical equivalence of scenario characteristics that are most relevant for the intended assessment, making it particularly appropriate for the domain of virtual safety assessments. We first review existing equivalence testing methods. Then we propose and demonstrate the Bayesian ROPE-based method by testing the equivalence of two rear-end pre-crash datasets. Our approach focuses on the most relevant scenario characteristics. Our analysis provides insights into the practicalities and effectiveness of equivalence testing in synthetic test scenario validation and demonstrates the importance of testing for improving the credibility of synthetic data for automated vehicle safety assessment, as well as the credibility of subsequent safety impact assessments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。