arXiv:2604.23765cs.LGcs.NE2026-04

证明了只需一个非线性函数,深度KAN网络就能逼近任意连续函数。

Necessary and sufficient conditions for universality of Kolmogorov-Arnold networks

  • 用单个非仿射函数替代部分线性边函数,即可实现万能逼近
  • 两层KAN需非多项式激活函数,深度网络仅需非仿射函数
  • 可用有限个线性函数组合替代全部仿射函数,降低参数复杂度

本文研究柯尔莫哥洛夫-阿诺德网络(KAN)的万能逼近性质,聚焦其边函数。若所有边函数均为仿射,则万能逼近不成立。我们证明:只要存在一个非仿射连续函数σ,所有边函数为仿射或等于σ的深KAN,即可在任意紧集K⊂ℝⁿ上稠密于C(K)。而两层KAN的万能逼近成立当且仅当σ为非多项式函数。进一步发现,全仿射函数并非必需,可用有限集合替代;对任意非仿射连续函数σ,存在有限仿射族A_σ,使得边函数取自A_σ∪{σ}的深KAN仍保持万能逼近性。此外,即使李等[2024]提出的样条参数化中样条次数和节点序列预先固定,此类KAN仍是经典意义上的万能逼近器。

原文摘要 · Abstract (English)

We analyze the universal approximation property of Kolmogorov-Arnold Networks (KANs) in terms of their edge functions. If these functions are all affine, then universality clearly fails. How many non-affine functions are needed, in addition to affine ones, to ensure universality? We show that a single one suffices. More precisely, we prove that deep KANs in which all edge functions are either affine or equal to a fixed continuous function $σ$ are dense in $C(K)$ for every compact set $K\subset\mathbb{R}^n$ if and only if $σ$ is non-affine. In contrast, for KANs with exactly two hidden layers, universality holds if and only if $σ$ is nonpolynomial. We further show that the full class of affine functions is not required; it can be replaced by a finite set without affecting universality. In particular, in the nonpolynomial case, a fixed family of five affine functions suffices when the depth is arbitrary. More generally, for every continuous non-affine function $σ$, there exists a finite affine family $A_σ$ such that deep KANs with edge functions in $A_σ\cup\{σ\}$ remain universal. We also prove that KANs with the spline-based edge parameterization introduced by Liu et al.~\cite{Liu2024} are universal approximators in the classical sense, even when the spline degree and knot sequence are fixed in advance.

KAN万能逼近非线性函数深度网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。