arXiv:2507.02916cs.LGcs.AI2025-07

提升二值神经网络的可信推理效率,速度最高快218倍。

Efficient Certified Reasoning for Binarized Neural Networks

  • 设计专用求解器与近似计数器,原生支持二值神经网络约束。
  • 验证速度比之前方法快9倍(定性)和218倍(定量),且结果全可认证。
  • 适用于安全关键场景,尤其适合需要高可信度的工业级部署。

神经网络在安全关键应用中日益重要,这类场景要求复杂且可信的计算。二值神经网络(BNNs)通过将每个神经元限制为布尔值,兼具全精度模型的计算能力,同时兼容可满足性求解器用于定性验证,以及模型计数器用于定量推理,因而特别适合安全关键任务。然而,现有BNN分析方法或扩展性差,或存在可靠性缺陷,难以应用于真实场景。本文提出一种可扩展且可信的BNN定性与定量验证方法。该方法在自研求解器中实现BNN约束的原生表示,用于定性推理;在近似模型计数器中实现定量推理。此外,构建了原生支持BNN约束推理的证明生成与验证流水线,确保所有结果可信。在BNN鲁棒性验证基准测试中,所提认证求解方法相比先前基于CNF和PB的方法提速9倍,认证计数方法相比传统CNF基线提速218倍。覆盖率方面,定性和定量推理查询分别获得99%和86%的完全认证结果,显著优于最佳现有基线(分别为62%和4%)。

原文摘要 · Abstract (English)

Neural networks have emerged as essential components in safety-critical applications -- these use cases demand complex, yet trustworthy computations. Binarized Neural Networks (BNNs) are a type of neural network where each neuron is constrained to a Boolean value; they are particularly well-suited for safety-critical tasks because they retain much of the computational capacities of full-scale (floating-point or quantized) deep neural networks, but remain compatible with satisfiability solvers for qualitative verification and with model counters for quantitative reasoning. However, existing methods for BNN analysis suffer from either limited scalability or susceptibility to soundness errors, which hinders their applicability in real-world scenarios. In this work, we present a scalable and trustworthy approach for both qualitative and quantitative verification of BNNs. Our approach introduces a native representation of BNN constraints in a custom-designed solver for qualitative reasoning, and in an approximate model counter for quantitative reasoning. We further develop specialized proof generation and checking pipelines with native support for BNN constraint reasoning, ensuring trustworthiness for all of our verification results. Empirical evaluations on a BNN robustness verification benchmark suite demonstrate that our certified solving approach achieves a $9\times$ speedup over prior certified CNF and PB-based approaches, and our certified counting approach achieves a $218\times$ speedup over the existing CNF-based baseline. In terms of coverage, our pipeline produces fully certified results for $99\%$ and $86\%$ of the qualitative and quantitative reasoning queries on BNNs, respectively. This is in sharp contrast to the best existing baselines which can fully certify only $62\%$ and $4\%$ of the queries, respectively.

二值网络可信推理形式验证高效求解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。