arXiv:2605.30155cs.LOcs.AI2026-05

通过选择性地对部分神经元使用多神经元松弛,提升验证效率与精度。

Neural Network Verification using Partial Multi-Neuron Relaxation

  • 仅对少数关键神经元使用多神经元松弛,平衡精度与计算开销。
  • 在多个数据集上验证成功率提升,最快提速1.7倍。
  • 适合需要高精度验证的自动驾驶、医疗系统等安全敏感场景。

深度神经网络在关键系统中的广泛应用催生了对其行为安全性进行形式化保证的理论与实践需求。当前验证算法依赖于对网络非线性激活函数计算线性松弛。现有方法主要分为单神经元松弛(仅约束单个激活神经元)和全量多神经元松弛(同时约束多个激活神经元),但前者松弛过松,后者计算成本过高。本文提出一种折中方案:部分多神经元松弛,即仅对少量通过启发式策略选出的关键神经元生成多神经元边界。该方法基于现有分支启发式策略,优化多神经元边界的超平面。我们将该方法集成至Marabou验证器,在多个基准测试中表现优于现有边界紧化方法,显著提升了验证效率与成功率。

原文摘要 · Abstract (English)

The increasing integration of deep neural networks in critical systems has spawned a theoretical and practical interest in formally guaranteeing safety properties about their behavior. To achieve this, contemporary verification algorithms rely on computing linear relaxations for a network's non-linear activation functions. Existing approaches for linear relaxations typically fall into one of two categories: single-neuron relaxation, in which each activation neuron is bounded in terms of its sources; and multi-neuron relaxation, in which linear bounds involving multiple activation neurons and their sources are calculated. However, existing methods might fail to balance tightness and scalability, as single-neuron bounds might not derive sufficiently tight bounds necessary for verification to complete, whereas generating multi-neuron relaxation for all activation neurons is computationally expensive. In this paper, we present a middle-ground approach featuring partial multi-neuron relaxation, in which we generate multi-neuron bounds for only a small, heuristically selected subset of neurons. To achieve this, we build upon existing branching heuristics for selecting neurons and for optimizing bounding hyper-planes for multi-neuron bounds. We integrated our proposed method within the Marabou verifier, and obtained favorable results in comparison to existing bound tightening methods. Our experiments showcase the potential of our technique for neural network verification.

神经网络验证松弛方法安全保证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。