提出PREMAP2,让神经网络认证能高效处理图像对抗攻击。
Efficient Preimage Approximation for Neural Network Certification
- 用改进分支策略和反向边界传播提升计算效率
- 支持卷积网络,可处理真实场景的贴纸攻击
- 适合关注模型可靠性与公平性的研究人员
人工智能在安全关键领域应用日益广泛,神经网络对错误或对抗性输入的鲁棒性引发关注。认证方法通过形式化保证模型行为来增强可信度。现有方法多聚焦于输出的最坏情况分析,而预像逼近方法可估算满足特定规范的输入比例,作为补充。然而,当前最先进的预像方法PREMAP仅适用于中等规模全连接网络。本文提出PREMAP2,通过改进分支启发式、自适应蒙特卡洛采样和反向边界传播,显著提升可扩展性与效率,并新增非均匀先验和置信区间支持。该方法成功应用于卷积神经网络的现实贴纸攻击场景,涵盖计算机视觉与控制任务中的可靠性、鲁棒性、可解释性与公平性认证,验证了其有效性。代码已开源。
原文摘要 · Abstract (English)
The growing reliance on artificial intelligence in safety- and security-critical applications is raising concerns about the robustness of neural networks to erroneous or adversarial input. Certification is a methodology for ensuring model trustworthiness by providing formal guarantees on model behaviour. While most verification methods focus on worst-case analysis by bounding the network output, an alternative approach based on approximating the preimage can complement such analysis by estimating the proportion of inputs that satisfy a given specification. However, existing preimage-based methods, such as the state-of-the-art PREMAP, are limited to fully connected neural networks of moderate dimensionality. In this paper, we introduce PREMAP2, a collection of algorithmic extensions to PREMAP that enhance its scalability and efficiency through improved branching heuristics, adaptive Monte Carlo sampling, and reverse bound propagation. We further endow PREMAP2 with additional functionality such as support for non-uniform priors and confidence intervals. These advances enable the application of PREMAP2 to previously intractable settings, including real-world patch attacks against convolutional neural networks, where adversarial stickers or lighting conditions obscure parts of images. We showcase the effectiveness of our approach across several use cases, including certifying reliability, robustness, interpretability, and fairness, on domains ranging from computer vision to control tasks. Our implementation is available as open-source software.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。