证明了2层ReLU神经网络的正性判定是参数化难问题,揭示其验证本质困难。
Parameterized Hardness of Zonotope Containment and Neural Network Verification
- 以输入维度d为参数,证明2层ReLU网络正性判定W[1]-难
- 首次表明zonoide包含性问题在维度上为W[1]-难,具独立几何意义
- 结果表明现有枚举法在指数时间下已最优,对验证算法设计有根本启示
具有ReLU激活函数的神经网络在机器学习中广泛应用,因此深入理解其计算函数的性质至关重要。近年来,关于这些性质判断的(参数化)计算复杂性研究日益增多。本文解决了Froese等人[COLT '25]提出的开放问题,明确了与网络验证相关若干问题的参数化复杂性。特别地,我们证明:当以输入维度d为参数时,2层ReLU网络计算函数的正性(从而满射性)判定属于W[1]-难。该结果同时表明,以d为参数的zonoide(非)包含性问题是W[1]-难的,这一问题在计算几何、控制理论和机器人学中具有独立重要性。此外,我们还证明:在2层网络中近似最大值的任意乘法因子、计算2层网络的L_p-利普希茨常数(p∈(0,∞])、以及近似3层网络的L_p-利普希茨常数,均为NP-hard且在参数d下为W[1]-hard。值得注意的是,这些硬度结果为迄今最强,意味着针对这些基础问题的朴素枚举方法在指数时间假设下均本质上最优。
原文摘要 · Abstract (English)
Neural networks with ReLU activations are a widely used model in machine learning. It is thus important to have a profound understanding of the properties of the functions computed by such networks. Recently, there has been increasing interest in the (parameterized) computational complexity of determining these properties. In this work, we close several gaps and resolve an open problem posted by Froese et al. [COLT '25] regarding the parameterized complexity of various problems related to network verification. In particular, we prove that deciding positivity (and thus surjectivity) of a function $f\colon\mathbb{R}^d\to\mathbb{R}$ computed by a 2-layer ReLU network is W[1]-hard when parameterized by $d$. This result also implies that zonotope (non-)containment is W[1]-hard with respect to $d$, a problem that is of independent interest in computational geometry, control theory, and robotics. Moreover, we show that approximating the maximum within any multiplicative factor in 2-layer ReLU networks, computing the $L_p$-Lipschitz constant for $p\in(0,\infty]$ in 2-layer networks, and approximating the $L_p$-Lipschitz constant in 3-layer networks are NP-hard and W[1]-hard with respect to $d$. Notably, our hardness results are the strongest known so far and imply that the naive enumeration-based methods for solving these fundamental problems are all essentially optimal under the Exponential Time Hypothesis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。