KAN回归估计器收敛率被证明,且与维度无关。
On the Rate of Convergence of Kolmogorov-Arnold Network Regression Estimators
- 用B样条构建KAN的最小二乘估计
- 收敛率达$O((\log n / n)^{2r/(2r+1)})$,与维度无关
- 适用于光滑度未知的自适应拟合,适合高维函数逼近研究者
Kolmogorov-Arnold网络(KANs)通过一元变换的加法或乘法聚合来逼近多元函数。本文建立了基于B样条的一元组件的KAN最小二乘估计的收敛性保证:在具有可表示为KAN形式、一元分量为Sobolev光滑度$r$的回归函数球上,估计器达到统一收敛率$O((\log n / n)^{2r/(2r+1)})$;匹配的下界表明该速率在对数因子范围内为极小极大最优,该对数因子源于筛集的非线性而非架构本身。该速率不依赖于环境维度$d$;此维度无关的指数反映了目标的KAN结构,而非逃离$[0,1]^d$上Sobolev类的极小极大率$n^{-2r/(2r+d)}$。我们推导出节点选择规则,证明在二进制节点网格上惩罚式选择能自适应未知光滑度并达到该速率;同时指出,在仅中心化条件下,一元组件不可识别,因此拟合一致不意味着组件一致。在已知精确光滑度的目标上,拟合风险指数在所有配置中至少达到该界,且预测的节点缩放和$k^{-r}$逼近衰减已被直接验证。
原文摘要 · Abstract (English)
Kolmogorov-Arnold Networks (KANs) approximate multivariate functions by composing univariate transformations through additive or multiplicative aggregation. We establish convergence guarantees for KANs whose univariate components are B-splines. The least-squares estimator over the KAN spline sieve attains the rate $O((\log n / n)^{2r/(2r+1)})$, uniformly over a ball of regression functions admitting a KAN representation with univariate components of Sobolev smoothness $r$; a matching lower bound of order $n^{-2r/(2r+1)}$ shows this is minimax optimal up to the logarithmic factor, which we trace to the nonlinearity of the sieve rather than to the architecture. The rate is free of the ambient dimension $d$; this dimension-free exponent reflects the assumed KAN structure of the target, not an escape from the minimax rate $n^{-2r/(2r+d)}$ on Sobolev classes over $[0,1]^d$. We derive a knot-selection rule, show that penalized selection over a dyadic knot grid attains the rate adaptively in the unknown smoothness, and show that univariate components are not identifiable under centering alone, so consistency of the fit does not imply consistency of the components. On targets of exactly known smoothness the fitted risk exponent is at least as steep as the bound in every configuration, and the predicted knot scaling and $k^{-r}$ approximation decay are checked directly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。