通过融合测试中间信息,提升自动驾驶系统安全评估的效率与准确性。
Make Full Use of Testing Information: An Integrated Accelerated Testing and Evaluation Method for Autonomous Driving Systems
- 利用测试过程中的树状结构信息,指导评估阶段精准定位危险区域。
- 改进UCB算法聚焦危险边界,加速搜索收敛,提升评估效率。
- 适用于高低维场景,对危险域形状不敏感,适合自动驾驶安全验证。
在自动驾驶系统大规模应用前,测试与评估至关重要。基于场景抽象三层理论,测试在逻辑场景内进行,评估阶段则输入由逻辑参数空间生成的具体场景测试结果。此过程中产生大量测试信息,有利于全面准确的评估。本文提出一种集成加速测试与评估方法(ITEM),基于蒙特卡洛树搜索(MCTS)和前期提出的双代理测试框架,将测试阶段生成的中间信息(如树结构、采样点归属子空间关系及父子子空间关系)引入评估阶段,实现危险域的精确识别。同时改进UCB计算方式,使搜索算法更聚焦于危险域边界。此外,构建基于搜索算法收敛性的停止条件。消融与对比实验验证了改进有效性及方法优越性。结果表明,ITEM在高低维情况下均能有效识别各类形状的危险域,具备通用性与安全性评估潜力。
原文摘要 · Abstract (English)
Testing and evaluation is an important step before the large-scale application of the autonomous driving systems (ADSs). Based on the three level of scenario abstraction theory, a testing can be performed within a logical scenario, followed by an evaluation stage which is inputted with the testing results of each concrete scenario generated from the logical parameter space. During the above process, abundant testing information is produced which is beneficial for comprehensive and accurate evaluations. To make full use of testing information, this paper proposes an Integrated accelerated Testing and Evaluation Method (ITEM). Based on a Monte Carlo Tree Search (MCTS) paradigm and a dual surrogates testing framework proposed in our previous work, this paper applies the intermediate information (i.e., the tree structure, including the affiliation of each historical sampled point with the subspaces and the parent-child relationship between subspaces) generated during the testing stage into the evaluation stage to achieve accurate hazardous domain identification. Moreover, to better serve this purpose, the UCB calculation method is improved to allow the search algorithm to focus more on the hazardous domain boundaries. Further, a stopping condition is constructed based on the convergence of the search algorithm. Ablation and comparative experiments are then conducted to verify the effectiveness of the improvements and the superiority of the proposed method. The experimental results show that ITEM could well identify the hazardous domains in both low- and high-dimensional cases, regardless of the shape of the hazardous domains, indicating its generality and potential for the safety evaluation of ADSs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。