让神经网络控制器自动满足复杂安全约束,无需牺牲性能。
ShardNet: Training Neural Controllers with Hard, Non-Convex Constraints

- 用可微投影层将安全约束嵌入网络结构中
- 在双积分器测试中实现100%安全且损失更低
- 适合对安全性要求极高的控制场景
尽管神经网络控制策略强大,但在安全关键系统中的部署依赖于严格遵守约束条件。现有方法常将安全视为需优化的指标,与其它性能目标竞争,甚至难以收敛。本文提出ShardNet,一种通过可微投影层(由分类网络参数化)构建的神经网络架构,能严格强制执行多面体约束的并集。核心思想是将安全嵌入网络结构中,使性能可独立优化,同时始终保证形式化安全。相比仅能处理简单凸约束的现有架构,ShardNet首次实现了闭环系统中非凸多面体并集或学习值函数等高超集的安全构造性合成。为此,我们还引入一种技术,可正确训练并验证作为ReLU网络的值函数,此前无法实现。在文献中的双积分器基准测试中,ShardNet策略在验证集上保持100%安全性,且目标损失显著低于现有形式化方法。此外,该值函数训练技术生成的安全集比现有验证方法大三倍以上。
原文摘要 · Abstract (English)
While neural network control policies are powerful, their deployment on safety critical systems depends on ensuring that they obey strict constraints. Existing work often treats safety as a metric to optimize for, which competes with other performance objectives, if training converges at all. Instead, we introduce ShardNet, a neural network architecture that strictly enforces unions of polyhedral constraints by construction, using a differentiable projection layer parameterized by a classification network. The key insight is to embed safety into the neural network's structure, allowing performance to be optimized independently because formal safety guarantees are always given. In contrast with existing neural architectures that can only enforce simple convex constraints, ShardNet enables the first safe-by-construction synthesis of forward-invariant neural network controllers on closed-loop systems where safety constraints are expressed as nonconvex unions of polyhedras or learned value function level sets. To support this, we also introduce a technique to verify and train such value functions correctly as rectified linear unit (ReLU) networks, which has not previously been possible. On double integrator benchmarks drawn from the literature, ShardNet policies maintain 100% safety on verified sets and achieves significantly lower objective loss compared to existing formal methods. Furthermore, our value function training technique also produces safe sets more than 3 times larger than existing verification approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。