提出高效定位神经网络验证边界的新方法,提升验证效率
Mining Verdict Boundaries for Neural Network Verification

- 利用激活函数单调性并行分割,跳过无关子问题
- 在多个基准上验证效率显著优于现有方法
- 适合需要完整验证的高可靠性系统开发者
分支定界(BaB)通过自适应划分问题并调用现成验证器来实现神经网络的完全验证。其问题划分历史可表示为一棵树,每个子问题对应一个子节点。当前方法在深度增加时逐个求解路径上的昂贵子问题,需在每个节点进行成本高昂的边界传播,效率低下。为此,我们提出新搜索策略:利用每条路径的单调性,同时分割多个激活函数(如ReLU),而非逐个处理。该方法沿路径执行有效指数搜索,能跳过大量与边界无关的子问题。增强版进一步通过子问题求解获得的定量信息估计边界位置。我们在常用基准上评估所提技术,并与近期基于BaB的方法对比。
原文摘要 · Abstract (English)
Branch and Bound (BaB) aims to achieve complete verification of neural networks by adaptively partitioning the problem and applying off-the-shelf verifiers to subproblems. Its problem-splitting history can be represented as a tree, where each subproblem corresponds to a child node. A key problem of BaB lies in searching for the verdict boundaries across all the paths that divide the verified and unverified subproblems. We observe that the existing BaB approach tackles this problem by solving each expensive subproblem sequentially along the tree path as its depth increases, requiring costly bounds propagation at every visited BaB tree node (i.e., subproblem), which is inefficient. To address this issue, we propose effective search approaches that leverage the monotonicity of each path to efficiently and precisely locate the verdict boundary by simultaneously splitting multiple activation functions (e.g., ReLU), rather than processing them one at a time as in the classical approach. Our approach performs an effective exponential search along each path, allowing us to skip many boundary-unrelated subproblems when identifying the verdict boundary. The enhanced version further improves this process by estimating the boundary's position using quantitative information obtained from subproblem solving. We perform experimental evaluation on commonly-used benchmarks to assess our proposed techniques, and compare them with recent BaB-based approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。