arXiv:2505.22104cs.AIcs.LG2025-05被引 1

动态盾牌可实时适应安全规则变化,提升自主系统响应速度。

Efficient Dynamic Shielding for Parametric Safety Specifications

  • 基于参数化安全规范设计动态盾牌,支持运行时快速自适应。
  • 实验中在线调整仅需毫秒至几秒,比重算快5倍以上。
  • 适合安全规则随环境变化的机器人导航等场景使用。

屏蔽技术被广泛用于保障人工智能控制的自主系统安全性。其核心是构建一个运行时监控并干预的工具——盾牌,以防止安全风险。传统盾牌针对特定安全要求静态设计,若运行时安全需求因环境变化而改变,需重新计算,导致延迟可能危及系统。本文提出针对参数化安全规范的动态盾牌,能预先为一组可能的安全规范设计盾牌,并在运行时根据实际揭示的安全约束动态调整。其关键创新在于一种简单高效的动态适应算法,利用标准盾牌的特性(如最大允许性)实现快速响应。在未知区域的机器人导航实验中,动态盾牌离线设计耗时数分钟,每次在线调整耗时在毫秒到数秒之间;而直接重算方法最慢可达其5倍。

原文摘要 · Abstract (English)

Shielding has emerged as a promising approach for ensuring safety of AI-controlled autonomous systems. The algorithmic goal is to compute a shield, which is a runtime safety enforcement tool that needs to monitor and intervene the AI controller's actions if safety could be compromised otherwise. Traditional shields are designed statically for a specific safety requirement. Therefore, if the safety requirement changes at runtime due to changing operating conditions, the shield needs to be recomputed from scratch, causing delays that could be fatal. We introduce dynamic shields for parametric safety specifications, which are succinctly represented sets of all possible safety specifications that may be encountered at runtime. Our dynamic shields are statically designed for a given safety parameter set, and are able to dynamically adapt as the true safety specification (permissible by the parameters) is revealed at runtime. The main algorithmic novelty lies in the dynamic adaptation procedure, which is a simple and fast algorithm that utilizes known features of standard safety shields, like maximal permissiveness. We report experimental results for a robot navigation problem in unknown territories, where the safety specification evolves as new obstacles are discovered at runtime. In our experiments, the dynamic shields took a few minutes for their offline design, and took between a fraction of a second and a few seconds for online adaptation at each step, whereas the brute-force online recomputation approach was up to 5 times slower.

安全强化动态适应机器人导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。