arXiv:2505.00963cs.LGcs.PL2025-05被引 2

用自适应搜索提升神经网络验证效率,更快发现漏洞

Adaptive Branch-and-Bound Tree Exploration for Neural Network Verification

  • 基于重要性评估动态选择验证分支,像猜谜一样优先探索可能出错的路径
  • 在MNIST和CIFAR-10上分别提速15.2倍和24.7倍,且能保证完整验证
  • 适合关注模型安全性的研究人员和工业界验证工具开发者

形式化验证可严格保证神经网络的质量,目前最先进的方法是分支定界(BaB),通过不断拆分问题并调用现成验证器来提高性能。然而,现有BaB方法效率不高,因其盲目探索子问题空间,忽视了不同子问题的重要性。为此,我们提出“重要性”概念,衡量一个子问题发现反例的可能性,并设计新方法ABONN,采用蒙特卡洛树搜索风格自适应探索子问题空间。该方法优先处理更可能发现反例的子问题,一旦找到反例即刻终止;若未找到,遍历全部子问题后仍可完成验证。我们在552个来自常用数据集和模型的验证任务上评估ABONN,与最先进验证器对比,实验表明其在MNIST上最高提速15.2倍,在CIFAR-10上最高提速24.7倍。我们还分析了超参数对性能的影响及自适应探索的有效性。

原文摘要 · Abstract (English)

Formal verification is a rigorous approach that can provably ensure the quality of neural networks, and to date, Branch and Bound (BaB) is the state-of-the-art that performs verification by splitting the problem as needed and applying off-the-shelf verifiers to sub-problems for improved performance. However, existing BaB may not be efficient, due to its naive way of exploring the space of sub-problems that ignores the \emph{importance} of different sub-problems. To bridge this gap, we first introduce a notion of ``importance'' that reflects how likely a counterexample can be found with a sub-problem, and then we devise a novel verification approach, called ABONN, that explores the sub-problem space of BaB adaptively, in a Monte-Carlo tree search (MCTS) style. The exploration is guided by the ``importance'' of different sub-problems, so it favors the sub-problems that are more likely to find counterexamples. As soon as it finds a counterexample, it can immediately terminate; even though it cannot find, after visiting all the sub-problems, it can still manage to verify the problem. We evaluate ABONN with 552 verification problems from commonly-used datasets and neural network models, and compare it with the state-of-the-art verifiers as baseline approaches. Experimental evaluation shows that ABONN demonstrates speedups of up to $15.2\times$ on MNIST and $24.7\times$ on CIFAR-10. We further study the influences of hyperparameters to the performance of ABONN, and the effectiveness of our adaptive tree exploration.

神经网络验证分支定界自适应搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。