arXiv:2606.23858cs.LGcs.AI2026-06

提出新指标与方法,更可靠地验证神经网络抗干扰能力

Are Safety Guarantees in Neural Networks Safe? How to Compute Trustworthy Robustness Certifications

论文配图:Are Safety Guarantees in Neural Networks Safe? How to Compute Trustworthy Robustness Certifications
图 1 · 摘自论文原文
  • 用'边心距'替代体积,更合理衡量神经网络鲁棒性
  • 在相同数据集上,最小边长提升至少两倍
  • 适合关注模型安全性的研究者和工程落地人员

AI安全的核心挑战之一是对抗样本——微小扰动即可导致神经网络误分类。为缓解此问题,近年研究聚焦于鲁棒性认证:对给定输入,计算其在不改变预测结果前提下的最大扰动范围。现有方法多以最大化认证区域体积为目标,但最新不可行性结果表明,无法在合理时间内求得体积最优解。本文提出边心距(apothem)度量,并证明可在与输入域直径呈线性关系的调用次数内,通过神经网络验证器(oracle)计算边心距最优认证。同时证明:即使忽略验证器开销,也无法实现体积最优且基于oracle的算法。此外,提出双认证机制——包含某一类别所有实例的区间,作为鲁棒性认证的边心距最小上界。最后,构建ParallelepipedoNN系统,在标准MNIST与Fashion MNIST数据集上评估,初步对比显示最小边长相较已有方法至少提升两倍。

原文摘要 · Abstract (English)

A primary challenge in AI safety is the existence of adversarial examples -- slightly distorted inputs that cause a neural network (NN) to misclassify. To mitigate this problem, recent research focuses on the computation of robustness certifications, which, for a given input, determine the largest distortion the input may receive without breaking the network's prediction. Robustness certifications can be interpreted as an axis-aligned hyper-rectangle (multi-dimensional intervals). Most existing approaches focus on maximizing the certification's volume, but recent intractability results prohibit the computation of volume-optimal certifications in reasonable time. We introduce the apothem measure and show how to compute apothem-optimal certifications in a linear number of calls to a NN verifier (oracle) w.r.t. the input domain's diameter. Moreover, we prove that we cannot have a volume-optimal, oracle-based algorithm, even if we discard the oracle costs. Also, we introduce dual certifications -- an interval including all instances of a class -- thus providing apothem-minimum upper bounds to a robustness certification. Further, we present the ParallelepipedoNN system, which we evaluate on the standard MNIST and Fashion MNIST benchmarks. A preliminary comparison with existing work on the same datasets reveals at least two-fold improvement w.r.t. the minimum edge length.

神经网络鲁棒性安全验证对抗样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。