arXiv:2409.08097eess.SYcs.LG2024-09被引 2

用多精度模拟器加速安全控制器的反例发现。

Optimizing Falsification for Learning-Based Control Systems: A Multi-Fidelity Bayesian Approach

  • 融合不同精度模拟器,动态选择最优评估层级。
  • 在多种Gym环境中,计算效率提升超50%。
  • 适合需要高效验证安全系统的研发团队。

在安全关键系统中,测试基于学习的闭环控制系统控制器至关重要。本文通过仿真解决学习型控制系统的反例检测问题,该问题可转化为满足安全需求的优化任务。使用全精度模拟器数据进行优化成本高昂。为提高效率,我们提出一种多精度贝叶斯优化反例检测框架,利用不同精度水平的模拟器,并建立它们之间的有效关联。通过多精度贝叶斯优化,同时确定最可能产生反例的系统输入及合适的评估精度。我们在多个具有不同精度级别的Gym环境上进行了实验,结果表明,与全精度贝叶斯优化及其他基线方法相比,该方法在检测反例时具有更高的计算效率。算法的Python实现已开源:https://github.com/SAILRIT/MFBO_Falsification。

原文摘要 · Abstract (English)

Testing controllers in safety-critical systems is vital for ensuring their safety and preventing failures. In this paper, we address the falsification problem within learning-based closed-loop control systems through simulation. This problem involves the identification of counterexamples that violate system safety requirements and can be formulated as an optimization task based on these requirements. Using full-fidelity simulator data in this optimization problem can be computationally expensive. To improve efficiency, we propose a multi-fidelity Bayesian optimization falsification framework that harnesses simulators with varying levels of accuracy. Our proposed framework can transition between different simulators and establish meaningful relationships between them. Through multi-fidelity Bayesian optimization, we determine both the optimal system input likely to be a counterexample and the appropriate fidelity level for assessment. We evaluated our approach across various Gym environments, each featuring different levels of fidelity. Our experiments demonstrate that multi-fidelity Bayesian optimization is more computationally efficient than full-fidelity Bayesian optimization and other baseline methods in detecting counterexamples. A Python implementation of the algorithm is available at https://github.com/SAILRIT/MFBO_Falsification.

控制验证贝叶斯优化多精度模拟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。