用决策树加速发现复杂系统中的安全隐患。
Data-Driven Falsification of Cyber-Physical Systems
- 构建系统代理模型,结合深度神经网络与决策树进行安全验证。
- 在ARCH-COMP 2024基准测试中成功找出难以发现的反例。
- 适合需要高效检测安全漏洞的自动驾驶等关键系统研究者。
网络物理系统(CPS)广泛应用于医疗、航空和自动驾驶等安全敏感领域,其运行安全的正式验证至关重要。本文聚焦于系统安全性验证中的“证伪”问题——即寻找系统中潜在的不安全执行路径,而非证明其绝对安全。提出一种新框架,将CPS的证伪问题与深度神经网络(DNN)的证伪相连接,并利用决策树的内在可解释性实现更快速的证伪。该框架通过:(1) 构建被测系统的代理模型(可为DNN或决策树),(2) 应用多种针对DNN的证伪工具对系统进行攻击测试,(3) 提出一种新型证伪算法,借助从决策树代理模型中提取的安全违规解释来引导搜索。该方法可复用专为增强DNN鲁棒性设计的对抗攻击算法及当前最先进的DNN证伪技术。尽管该方法适用于可模拟的一般系统,但本文重点展示了其在具有线性和非线性动态特性的CPS中的有效性。所实现的工具 extsc{FlexiFal}在ARCH-COMP 2024证伪基准测试中成功识别出多个难寻的反例。
原文摘要 · Abstract (English)
Cyber-Physical Systems (CPS) are abundant in safety-critical domains such as healthcare, avionics, and autonomous vehicles. Formal verification of their operational safety is, therefore, of utmost importance. In this paper, we address the falsification problem, where the focus is on searching for an unsafe execution in the system instead of proving their absence. The contribution of this paper is a framework that (a) connects the falsification of CPS with the falsification of deep neural networks (DNNs) and (b) leverages the inherent interpretability of Decision Trees for faster falsification of CPS. This is achieved by: (1) building a surrogate model of the CPS under test, either as a DNN model or a Decision Tree, (2) application of various DNN falsification tools to falsify CPS, and (3) a novel falsification algorithm guided by the explanations of safety violations of the CPS model extracted from its Decision Tree surrogate. The proposed framework has the potential to exploit a repertoire of \emph{adversarial attack} algorithms designed to falsify robustness properties of DNNs, as well as state-of-the-art falsification algorithms for DNNs. Although the presented methodology is applicable to systems that can be executed/simulated in general, we demonstrate its effectiveness, particularly in CPS. We show that our framework, implemented as a tool \textsc{FlexiFal}, can detect hard-to-find counterexamples in CPS that have linear and non-linear dynamics. Decision tree-guided falsification shows promising results in efficiently finding multiple counterexamples in the ARCH-COMP 2024 falsification benchmarks~\cite{khandait2024arch}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。