arXiv:2605.20482cs.LGcs.SY2026-05

提出可验证的二次约束方法,提升神经网络可达性分析精度

Quadratic Characterizations for Reachability Analysis of Neural Networks

论文配图:Quadratic Characterizations for Reachability Analysis of Neural Networks
图 1 · 摘自论文原文
  • 通过凸二次规划生成局部二次不等式,结合平方和证书全局验证
  • 对平滑激活函数实现更紧致的约束,使神经网络可达性分析更精确
  • 适用于非线性系统分析,特别适合减少ReLU网络的保守性

二次约束(QCs)广泛用于表征非线性和不确定性,但通用解析表征在有界域上可能过于保守。本文提出一种框架,用于构造二维实平面上标量关系的可验证二次表征。通过采样关系内部及外部点,求解凸二次规划生成候选二次不等式,并利用平方和证书在精确代数描述或松弛多项式描述下进行全局验证。所得约束为所考虑域上标量关系的可靠超逼近。这些约束可直接兼容基于二次约束和逐点积分二次约束(IQCs)的静态非线性与不确定性分析框架,也可嵌入二次约束型半定规划中,用于前馈神经网络的可达性与安全性分析。对于如 tanh 等光滑激活函数,该方法提供依赖于域的二次表征,替代传统的扇区或斜率法。对于 ReLU 网络,通过挖掘神经元间依赖关系与更紧的局部边界,降低二次约束分析中的保守性。数值实验表明,该方法对平滑激活函数提升了可达性结果,降低了 ReLU 网络的保守性,并在饱和系统等场景中具有适用性。

原文摘要 · Abstract (English)

Quadratic constraints (QCs) are widely used to characterize nonlinearities and uncertainties, but generic analytical characterizations can be conservative on bounded domains. This paper develops a framework for constructing verified quadratic characterizations of scalar relations in the two-dimensional real plane. Candidate quadratic inequalities are locally generated by solving convex quadratic programs using samples from the relation and exterior sample points. They are then verified globally using sum-of-squares certificates over an exact semialgebraic description or, in the case of nonpolynomial relations, over relaxed polynomial descriptions. The resulting verified constraints define a sound overapproximation of the scalar relations over the considered domains. These constraints are directly compatible with existing analysis frameworks based on QCs and pointwise integral quadratic constraints (IQCs) for static nonlinearities and uncertainties, and they can also be embedded in QC-based semidefinite programs for reachability and safety analysis of feedforward neural networks. For smooth activations such as $\tanh$, the method yields domain-dependent quadratic characterizations that constitute an alternative to generic sector- or slope-based descriptions. For ReLU networks, we give methods to reduce conservatism in QC-based reachability analysis of feedforward networks by exploiting dependencies between neurons and tighter local bounds. Numerical examples demonstrate improved reachability results for smooth activations, reduced conservatism for ReLU networks, and applicability beyond neural networks through an example involving saturation.

神经网络可达性分析二次约束优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。