用数据学习神经网络系统的安全屏障,确保自动驾驶等场景的运行安全。
Kernel-Based Learning of Safety Barriers
- 基于核方法在希尔伯特空间中嵌入轨迹数据,构建可扩展的安全屏障。
- 将复杂优化问题转为线性规划,结合快速傅里叶变换实现高效计算。
- 适用于黑箱系统与复杂时序逻辑,适合对安全性要求高的智能系统开发。
人工智能在自动驾驶、医疗等高安全性场景中的快速应用,带来了严格安全标准难以满足的挑战。传统形式化安全验证方法因难以处理黑箱型AI系统且缺乏可扩展性而受限。本文提出一种数据驱动的安全验证与合成方法,针对具有离散时间随机动力学的黑箱系统,采用控制屏障证书(control barrier certificates)来保证系统安全,并直接从系统轨迹中学习该证书。通过条件均值嵌入将数据映射到再生核希尔伯特空间(RKHS),构建可膨胀的RKHS不确定性集,以增强对分布外行为的鲁棒性。理论上扩展至一般时序逻辑规范。为实现数据驱动的安全屏障计算,采用有限傅里叶展开,将通常不可解的半无限优化问题转化为线性规划,生成谱屏障,利用快速傅里叶变换高效求解。该框架在两个案例研究中验证,包括一个含神经网络控制器的黑箱系统,展现出超越传统动态与不确定性假设的通用性与可扩展性。
原文摘要 · Abstract (English)
The rapid integration of AI algorithms in safety-critical applications such as autonomous driving and healthcare is raising significant concerns about the ability to meet stringent safety standards. Traditional tools for formal safety verification struggle with the black-box nature of AI-driven systems and lack the flexibility needed to scale to the complexity of real-world applications. In this paper, we present a data-driven approach for safety verification and synthesis of black-box systems with discrete-time stochastic dynamics. We employ the concept of control barrier certificates, which can guarantee safety of the system, and learn the certificate directly from a set of system trajectories. We use conditional mean embeddings to embed data from the system into a reproducing kernel Hilbert space (RKHS) and construct an RKHS ambiguity set that can be inflated to robustify the result to out-of-distribution behavior. We provide the theoretical results on how to apply the approach to general classes of temporal logic specifications beyond safety. For the data-driven computation of safety barriers, we leverage a finite Fourier expansion to cast a typically intractable semi-infinite optimization problem as a linear program. The resulting spectral barrier allows us to leverage the fast Fourier transform to generate the relaxed problem efficiently, offering a scalable yet distributionally robust framework for verifying safety. Our work moves beyond restrictive assumptions on system dynamics and uncertainty, as demonstrated on two case studies including a black-box system with a neural network controller.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。