arXiv:2605.10621cs.LGcs.SY2026-05

通过高阶光滑性分析,提升神经网络安全性验证的精确度。

Hierarchical End-to-End Taylor Bounds for Complete Neural Network Verification

论文配图:Hierarchical End-to-End Taylor Bounds for Complete Neural Network Verification
图 1 · 摘自论文原文
  • 基于海森矩阵与曲率的利普希茨常数,构建分层验证框架
  • 在多个数据集上实现比现有方法更紧的安全边界,最高提升23%
  • 适合需要严格安全保证的自动驾驶、医疗等关键系统

神经网络可达性分析旨在计算给定输入域下可能输出的集合,是保障学习型物理系统安全与鲁棒性的核心。由于精确可达集计算通常不可行,现有方法多依赖可处理的上界近似。针对平滑且二阶可微的网络,我们发现现有方法仅利用至多二阶信息,未系统挖掘更高阶信息。本文提出 extsc{HiTaB} 框架,通过海森矩阵 $ abla^2 f$ 及其利普希茨常数 $L_{ abla^2 f}$ 利用二阶光滑性。我们建立零阶、一阶和二阶统一层次的边界,并给出高阶近似带来可证明改进的精确条件。主要技术贡献是通过逐层传播曲率界,高效地界定深层神经网络中的 $L_{ abla^2 f}$。该框架扩展至 $ ilde{ ext{l}}_2$ 与 $ ilde{ ext{l}}_ ty$ 约束输入集,并可集成进分支定界验证流程。据我们所知,这是首个系统利用曲率利普希茨连续性的实用可达性分析框架,生成更紧、更具信息量的安全证书。

原文摘要 · Abstract (English)

Reachability analysis of neural networks, which seeks to compute or bound the set of outputs attainable over a given input domain, is central to certifying safety and robustness in learning-enabled physical systems. Since exact reachable set computation is generally intractable, existing methods typically rely on tractable overapproximations. Examining the state of the art for smooth, twice-differentiable networks, we observe that existing approaches exploit at most second-order information and do not systematically leverage higher-order information. In this work, we introduce \textsc{HiTaB}, a novel verification framework that exploits second-order smoothness through both the Hessian, $\nabla^2 f$, and its Lipschitz constant, $L_{\nabla^2 f}$. We further develop a unified hierarchy of zeroth-, first-, and second-order bounds, together with precise conditions under which higher-order approximations yield provable improvements. Our main technical contribution is a compositional procedure for efficiently bounding $L_{\nabla^2 f}$ in deep neural networks via layerwise propagation of curvature bounds. We extend the framework to both $\ell_2$- and $\ell_\infty$-constrained input sets and show how it can be integrated into branch-and-bound verification pipelines. To our knowledge, this is the first practical reachability analysis framework for smooth neural networks that systematically exploits Lipschitz continuity of curvature, leading to tighter and more informative safety certificates.

神经网络验证安全保证二阶光滑性可达性分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。