arXiv:2411.18235cs.LGcs.AI2024-11被引 3

提出CT-BaB框架,让神经控制器训练时就具备可验证的稳定性保证。

Certified Training with Branch-and-Bound for Lyapunov-stable Neural Control

  • 训练中用分支定界法动态拆分难点区域,优化可验证边界。
  • 在2D四旋翼系统上验证时间减少11倍,吸引域扩大164倍。
  • 适合需要高安全性控制的机器人、自动驾驶等场景。

我们研究学习可验证李雅普诺夫稳定的神经控制器,使其在吸引域(ROA)内严格满足李雅普诺夫渐近稳定条件。与以往仅依赖反例引导训练而忽略验证计算的方法不同,本文提出认证训练结合分支定界法(CT-BaB),在训练中直接优化可认证边界,从而缩小训练与测试时验证之间的差距。为实现对整个输入关注区域的相对全局保证,我们设计了训练时的分支定界技术,动态维护训练数据集并自适应地将困难子区域拆分为更小区域,以收紧认证边界并降低训练难度。同时,训练时生成的子区域可指导测试时的验证,提升训练感知的验证效率。实验表明,CT-BaB生成的模型更易验证,且可实现更强的可验证保证和更大的吸引域。在最大规模的输出反馈2D四旋翼系统上,相比之前的最先进基线(CEGIS),CT-BaB将验证时间降低超过11倍,同时吸引域扩大164倍。代码已开源:https://github.com/shizhouxing/CT-BaB。

原文摘要 · Abstract (English)

We study the problem of learning verifiably Lyapunov-stable neural controllers that provably satisfy the Lyapunov asymptotic stability condition within a region-of-attraction (ROA). Unlike previous works that adopted counterexample-guided training without considering the computation of verification in training, we introduce Certified Training with Branch-and-Bound (CT-BaB), a new certified training framework that optimizes certified bounds, thereby reducing the discrepancy between training and test-time verification that also computes certified bounds. To achieve a relatively global guarantee on an entire input region-of-interest, we propose a training-time BaB technique that maintains a dynamic training dataset and adaptively splits hard input subregions into smaller ones, to tighten certified bounds and ease the training. Meanwhile, subregions created by the training-time BaB also inform test-time verification, for a more efficient training-aware verification. We demonstrate that CT-BaB yields verification-friendly models that can be more efficiently verified at test time while achieving stronger verifiable guarantees with larger ROA. On the largest output-feedback 2D Quadrotor system experimented, CT-BaB reduces verification time by over 11X relative to the previous state-of-the-art baseline using Counterexample Guided Inductive Synthesis (CEGIS), while achieving 164X larger ROA. Code is available at https://github.com/shizhouxing/CT-BaB.

神经控制可验证性稳定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。