arXiv:2605.10219math.OCcs.CC2026-05

研究分段线性函数驻点检测的参数复杂度,揭示其在低维下可解、高维下难解的本质。

Parameterized Complexity of Stationarity Testing for Piecewise-Affine Functions and Shallow CNN Losses

  • 以环境维度为参数,构建固定维下的可解算法
  • 证明在互补情况下为W[1]-难,且无法在亚指数时间内求解
  • 结果适用于浅层ReLU卷积网络训练损失的驻点检验

我们研究了在指定点测试连续分段仿射(PA)函数近似一阶驻点的参数化复杂度,这是非光滑优化中的基础任务。PA函数是刻画非光滑驻点检测的典型模型,能捕捉ReLU型训练损失中出现的局部多面体几何结构。近期Tian和So(SODA 2025)表明,在最坏情况下测试PA函数的近似驻点概念是计算上不可行的,并将固定维可解性列为开放方向。本文从参数化复杂度视角出发,以环境维度 $d$ 为参数,给出了固定维下可解的XP算法,并证明了互补情况下的W[1]-难性。此外,在指数时间假设下,排除了运行时间低于 $ρ(d) imes ext{size}^{o(d)}$ 的算法存在性,其中 $ ext{size}$ 表示驻点检测实例的总二进制编码长度。作为进一步结果,我们的结论也给出了连续PA函数局部极小性的参数化复杂度图景。我们还将硬度结果扩展到一类浅层ReLU CNN训练损失,驻点在可训练权重空间中测试。因此,简单CNN训练损失也呈现出相同的参数化复杂度结构。

原文摘要 · Abstract (English)

We study the parameterized complexity of testing approximate first-order stationarity at a prescribed point for continuous piecewise-affine (PA) functions, a basic task in nonsmooth optimization. PA functions form a canonical model for nonsmooth stationarity testing and capture the local polyhedral geometry that appears in ReLU-type training losses. Recent work by Tian and So (SODA 2025) shows that testing approximate stationarity notions for PA functions is computationally intractable in the worst case, and identifies fixed-dimensional tractability as an open direction. We address this direction from the viewpoint of parameterized complexity, with the ambient dimension $d$ as the parameter. In this paper, we give XP algorithms in fixed dimension for the tractable sides, and prove W[1]-hardness for the complementary sides. Moreover, lower bounds under the Exponential Time Hypothesis rule out algorithms running in time $ρ(d)\size^{o(d)}$ for any computable function $ρ$, where $\size$ denotes the total binary encoding length of the stationarity-testing instance. As a further consequence, our results yield the corresponding parameterized complexity picture for testing local minimality of continuous PA functions. We further extend our hardness results to a family of shallow ReLU CNN training losses, with stationarity tested in the trainable weight space. Thus, the same parameterized-complexity picture also appears for simple CNN training losses.

非光滑优化参数复杂度神经网络训练驻点检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。