arXiv:2505.05235cs.AI2025-05被引 6

提出分层安全抽象方法,精细评估神经网络的鲁棒性等级。

Advancing Neural Network Verification through Hierarchical Safety Abstract Interpretation

  • 用抽象解释构建输出可达集,实现多级安全评估
  • 可按安全违规程度排序对抗样本,揭示模型脆弱层级
  • 计算开销与传统方法相当或更低,适合复杂场景验证

传统深度神经网络(DNN)形式化验证受限于安全属性的二元编码:模型要么安全,要么不安全。这种二元判断无法捕捉模型内部的安全性差异,常导致要求过严或过松。本文提出新的抽象DNN验证问题,通过验证不安全输出的分层结构,实现对模型安全性的更细粒度分析。关键在于利用抽象解释和输出可达集推理,可在验证过程中评估多个安全等级,计算开销在最坏情况下与传统方法相当,甚至更优。我们证明该方法可按抽象安全等级违规程度对对抗样本进行排序,提供更细致的模型安全性与鲁棒性评估。贡献包括新抽象安全形式与现有抽象解释方法的理论关联、新问题的复杂性分析,以及在复杂深度强化学习任务(基于Habitat 3.0)和标准DNN验证基准上的实证评估。

原文摘要 · Abstract (English)

Traditional methods for formal verification (FV) of deep neural networks (DNNs) are constrained by a binary encoding of safety properties, where a model is classified as either safe or unsafe (robust or not robust). This binary encoding fails to capture the nuanced safety levels within a model, often resulting in either overly restrictive or too permissive requirements. In this paper, we introduce a novel problem formulation called Abstract DNN-Verification, which verifies a hierarchical structure of unsafe outputs, providing a more granular analysis of the safety aspect for a given DNN. Crucially, by leveraging abstract interpretation and reasoning about output reachable sets, our approach enables assessing multiple safety levels during the FV process, requiring the same (in the worst case) or even potentially less computational effort than the traditional binary verification approach. Specifically, we demonstrate how this formulation allows rank adversarial inputs according to their abstract safety level violation, offering a more detailed evaluation of the model's safety and robustness. Our contributions include a theoretical exploration of the relationship between our novel abstract safety formulation and existing approaches that employ abstract interpretation for robustness verification, complexity analysis of the novel problem introduced, and an empirical evaluation considering both a complex deep reinforcement learning task (based on Habitat 3.0) and standard DNN-Verification benchmarks.

神经网络验证抽象解释鲁棒性评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。