arXiv:2602.05068cs.LGcs.AI2026-02

提出新方法实现神经网络全局验证,速度快且结果更精确。

E-Globe: Scalable $ε$-Global Verification of Neural Networks via Tight Upper Bounds and Pattern-Aware Branching

  • 用带互补约束的非线性规划紧致上界,保持ReLU结构
  • 在MNIST和CIFAR-10上上界比PGD紧三数量级,求解快
  • 适合对安全要求高的场景,如自动驾驶与医疗诊断

神经网络虽表现优异,但鲁棒性问题仍阻碍其在安全关键场景部署。形式化验证可提供鲁棒性保障,但现有方法存在可扩展性与完备性权衡。本文提出一种基于分支定界(BaB)框架的混合验证器,通过高效紧致上下界直至达到ε-全局最优或触发提前终止。核心是保留ReLU输入输出图结构的精确非线性规划与互补约束(NLP-CC)上界模型,任意可行解即为有效反例,支持快速剪枝不安全子问题。进一步通过(i)仅需少量约束矩阵更新的热启动NLP求解,及(ii)按模式对齐的强分支策略,优先选择最能紧致松弛的分割。还给出了NLP-CC上界紧致的条件。在MNIST与CIFAR-10上的实验表明,上界比PGD紧达三个数量级,单节点求解迅速,相比基于MIP的验证实现显著端到端加速,热启动、GPU批处理与模式对齐分支进一步放大优势。

原文摘要 · Abstract (English)

Neural networks achieve strong empirical performance, but robustness concerns still hinder deployment in safety-critical applications. Formal verification provides robustness guarantees, but current methods face a scalability-completeness trade-off. We propose a hybrid verifier in a branch-and-bound (BaB) framework that efficiently tightens both upper and lower bounds until an $ε-$global optimum is reached or early stop is triggered. The key is an exact nonlinear program with complementarity constraints (NLP-CC) for upper bounding that preserves the ReLU input-output graph, so any feasible solution yields a valid counterexample and enables rapid pruning of unsafe subproblems. We further accelerate verification with (i) warm-started NLP solves requiring minimal constraint-matrix updates and (ii) pattern-aligned strong branching that prioritizes splits most effective at tightening relaxations. We also provide conditions under which NLP-CC upper bounds are tight. Experiments on MNIST and CIFAR-10 show markedly tighter upper bounds than PGD across perturbation radii spanning up to three orders of magnitude, fast per-node solves in practice, and substantial end-to-end speedups over MIP-based verification, amplified by warm-starting, GPU batching, and pattern-aligned branching.

神经网络验证全局优化分支定界鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。