通过隐空间精炼输入,提升神经网络验证效率与准确性。
Out of the Shadows: Exploring a Latent Space for Neural Network Verification
- 利用隐空间映射输出约束到输入,迭代缩小不安全输入范围。
- 基于区间表示的矩阵运算实现,支持GPU加速,显著提升速度。
- 适合需要高可靠性验证的自动驾驶、医疗等安全关键场景。
神经网络广泛应用,但对微小输入变化敏感,因此在安全关键应用中需进行形式化验证——这一问题极为困难。现有先进验证算法常使用可达性分析或抽象解释来封闭神经网络的可能输出集,但因封装过于保守,常导致验证结果不确定。为此,本文提出一种新型指定驱动的输入精炼方法:通过将输出不安全区域的预像逐次封闭,仅保留潜在不安全输入。该方法利用隐空间——由投影集合表示(如区间)在神经网络传播过程中形成的高维空间“影子”——将输出约束传递至输入空间。输入集与输出封闭集均为同一隐空间的“影子”,可有效转移约束。我们构建了一款高效验证工具,采用此迭代精炼策略,大幅减少分支定界过程中的子问题数量。采用区间作为集合表示,无需复杂非线性操作,仅用矩阵运算即可实现,极大提升计算效率并支持GPU加速。实验表明,本工具在国际神经网络验证竞赛中表现优于多数顶尖工具。
原文摘要 · Abstract (English)
Neural networks are ubiquitous. However, they are often sensitive to small input changes. Hence, to prevent unexpected behavior in safety-critical applications, their formal verification -- a notoriously hard problem -- is necessary. Many state-of-the-art verification algorithms use reachability analysis or abstract interpretation to enclose the set of possible outputs of a neural network. Often, the verification is inconclusive due to the conservatism of the enclosure. To address this problem, we propose a novel specification-driven input refinement procedure, i.e., we iteratively enclose the preimage of a neural network for all unsafe outputs to reduce the set of possible inputs to only enclose the unsafe ones. For that, we transfer output specifications to the input space by exploiting a latent space, which is an artifact of the propagation of a projection-based set representation through a neural network. A projection-based set representation, e.g., a zonotope, is a "shadow" of a higher-dimensional set -- a latent space -- that does not change during a set propagation through a neural network. Hence, the input set and the output enclosure are "shadows" of the same latent space that we can use to transfer constraints. We present an efficient verification tool for neural networks that uses our iterative refinement to significantly reduce the number of subproblems in a branch-and-bound procedure. Using zonotopes as a set representation, unlike many other state-of-the-art approaches, our approach can be realized by only using matrix operations, which enables a significant speed-up through efficient GPU acceleration. We demonstrate that our tool achieves competitive performance compared to the top-ranking tools of the international neural network verification competition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。