arXiv:2511.07899cs.LGcs.AI2025-11被引 5

用集合安全过滤器与置信预测,让学习到的控制器更安全可靠。

Statistically Assuring Safety of Control Systems using Ensembles of Safety Filters and Conformal Prediction

  • 用置信预测校准安全策略切换,确保决策可信
  • 集成多个学习值函数,提升安全边界可靠性
  • 适合对安全性要求高的自主系统部署场景

安全保证是部署学习型自主系统的基本需求。哈密顿-雅可比(HJ)可达性分析是形式化验证安全性和生成安全控制器的核心方法,但计算刻画后向可达集(BRS)的HJ值函数在高维系统中计算成本高昂,促使采用强化学习近似该值函数。然而,学习得到的值函数及其对应的安全策略无法保证正确性——在特定状态评估的值函数可能不等于遵循该策略所实现的真实安全回报。为解决此问题,本文提出基于置信预测(CP)的框架,以量化此类不确定性并提供概率性安全保证。通过使用CP校准非安全主控制器与基于学习的HJ安全策略之间的切换,并推导出该切换策略下的安全保证。此外,还研究了使用一组独立训练的HJ值函数作为安全滤波器的方法,并将其与单独使用单个值函数进行对比。

原文摘要 · Abstract (English)

Safety assurance is a fundamental requirement for deploying learning-enabled autonomous systems. Hamilton-Jacobi (HJ) reachability analysis is a fundamental method for formally verifying safety and generating safe controllers. However, computing the HJ value function that characterizes the backward reachable set (BRS) of a set of user-defined failure states is computationally expensive, especially for high-dimensional systems, motivating the use of reinforcement learning approaches to approximate the value function. Unfortunately, a learned value function and its corresponding safe policy are not guaranteed to be correct. The learned value function evaluated at a given state may not be equal to the actual safety return achieved by following the learned safe policy. To address this challenge, we introduce a conformal prediction-based (CP) framework that bounds such uncertainty. We leverage CP to provide probabilistic safety guarantees when using learned HJ value functions and policies to prevent control systems from reaching failure states. Specifically, we use CP to calibrate the switching between the unsafe nominal controller and the learned HJ-based safe policy and to derive safety guarantees under this switched policy. We also investigate using an ensemble of independently trained HJ value functions as a safety filter and compare this ensemble approach to using individual value functions alone.

安全控制置信预测强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。