为自动驾驶汽车设计行为安全评估框架,提升真实道路部署安全性。
Behavioral Safety Assessment towards Large-scale Deployment of Autonomous Vehicles
- 提出驾驶执照测试与驾驶智能测试双组件评估框架。
- 实测显示自动驾驶系统每英里事故率是人类的1000倍。
- 发现未预料的危险场景,适合安全团队与车企参考。
近年来,自动驾驶汽车在现实道路部署中取得显著进展,但安全仍是大规模推广的关键障碍。传统功能安全方法仅从车辆自身角度验证软硬件可靠性,未能充分考量自动驾驶系统对周边交通环境的行为影响。为此,我们提出行为安全新范式,聚焦评估自动驾驶系统在交通环境中的响应与交互行为。为此构建第三方安全评估框架,包含两个互补组件:驾驶执照测试用于评估受控场景下的反应行为,确保基本行为能力;驾驶智能测试则在自然交通条件下评估交互行为,量化安全关键事件频率,提供可统计的安全指标。我们使用开源Level 4自动驾驶系统Autoware.Universe,在仿真环境和密歇根大学Mcity测试场进行验证。结果显示,Autoware.Universe在14个场景中仅通过6个,且事故率为3.01e-3次/英里,约为人类驾驶员的1000倍。测试中还发现了多个未知的高风险场景。这些结果凸显了行为安全评估在大规模公共部署前的重要性。
原文摘要 · Abstract (English)
Autonomous vehicles (AVs) have significantly advanced in real-world deployment in recent years, yet safety continues to be a critical barrier to widespread adoption. Traditional functional safety approaches, which primarily verify the reliability, robustness, and adequacy of AV hardware and software systems from a vehicle-centric perspective, do not sufficiently address the AV's broader interactions and behavioral impact on the surrounding traffic environment. To overcome this limitation, we propose a paradigm shift toward behavioral safety, a comprehensive approach focused on evaluating AV responses and interactions within traffic environment. To systematically assess behavioral safety, we introduce a third-party AV safety assessment framework comprising two complementary evaluation components: Driver Licensing Test and Driving Intelligence Test. The Driver Licensing Test evaluates AV's reactive behaviors under controlled scenarios, ensuring basic behavioral competency. In contrast, the Driving Intelligence Test assesses AV's interactive behaviors within naturalistic traffic conditions, quantifying the frequency of safety-critical events to deliver statistically meaningful safety metrics before large-scale deployment. We validated our proposed framework using \texttt{Autoware.Universe}, an open-source Level 4 AV, tested both in simulated environments and on the physical test track at the University of Michigan's Mcity Testing Facility. The results indicate that \texttt{Autoware.Universe} passed 6 out of 14 scenarios and exhibited a crash rate of 3.01e-3 crashes per mile, approximately 1,000 times higher than average human driver crash rate. During the tests, we also uncovered several unknown unsafe scenarios for \texttt{Autoware.Universe}. These findings underscore the necessity of behavioral safety evaluations for improving AV safety performance prior to widespread public deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。