arXiv:2608.25807cs.LGstat.ML2026-08

让神经网络自己学如何处理数据几何,提升精度与稳定性。

Geometry-Constrained Kolmogorov-Arnold Networks: Learning Edge Geometry via Banach Duality

论文配图:Geometry-Constrained Kolmogorov-Arnold Networks: Learning Edge Geometry via Banach Duality
图 1 · 摘自论文原文
  • 用可学习的几何参数替代固定函数基,动态适应数据结构。
  • 在50个符号回归任务中,平均表现优于传统方法,噪声下更稳定。
  • 适合追求模型可解释性与小样本性能的研究者。

Kolmogorov-Arnold网络(KANs)将深度架构中的固定激活替换为可学习的一维边函数,使边函数参数化选择成为关键。现有变体依赖固定基如样条、多项式或傅里叶特征,提前设定函数空间几何。本文提出几何约束型KAN,其边激活基于Banach对偶映射,通过每边的标量指数𝑝 > 1学习几何本身。该指数控制响应特性:𝑝 < 2时产生尖锐阈值行为(类似ℓ₁),𝑝 = 2对应线性,更大值则在原点附近趋于平坦。在50个符号回归任务(40个来自AI Feynman基准+10个合成压力测试)上,几何约束型KAN在中位数NRMSE上达到0.030,与切比雪夫基持平并优于样条;在核心18方程集平均排名最佳(2.00),全基准上与最强样条持平(2.32 vs. 2.34)。噪声环境下优势显著:当σ从0增至1时,ℓ^p-KAN退化仅3.7倍(低于交叉验证样条的≈11倍),而未正则化样条退化21.6倍;贝奈克KAN退化8.8倍,接近调优样条但远优于未正则化版本。小样本下胜率最高,固定基模型仅随训练集增大才逐渐追上。学习到的指数提供可解释的相对信号,在固定初始化下揭示目标相关的几何排序模式。

原文摘要 · Abstract (English)

Kolmogorov-Arnold Networks (KANs) replace fixed activations in deep architectures with learnable univariate edge functions, making the choice of edge parametrisation central. Existing variants rely on fixed bases such as splines, polynomials, or Fourier features, which impose a function-space geometry before data are observed. We introduce geometry-constrained KANs, a family of edge activations derived from Banach duality maps in which the geometry itself is learned through a scalar exponent $p > 1$ per edge. This exponent controls the qualitative response: sub-Euclidean values produce sharp, threshold-like behaviour reminiscent of the $\ell_1$ (LASSO) geometry, $p = 2$ recovers the linear regime, and larger values produce flatter responses near the origin. Across 50 symbolic-regression targets ($40$ from the AI Feynman benchmark plus $10$ synthetic stress tests), geometry-constrained KANs match or beat every fixed-basis baseline on median NRMSE (Banach-KAN $0.030$, tying Chebyshev and improving on splines); on average rank Banach-KAN is best on the $18$-equation core ($2.00$) and statistically tied with the strongest spline on the full benchmark ($2.32$ vs. $2.34$). The clearest gains appear under measurement noise: as $σ$ grows from $0$ to $1$, $\ell^p$-KAN degrades only $3.7\times$ -- below even a cross-validated spline ($\approx 11\times$) -- while an unregularised spline degrades $21.6\times$; Banach-KAN degrades $8.8\times$, comparable to a tuned spline but far more stable than the unregularised one. Banach-KAN also takes the most per-equation wins in the small-sample regime, with fixed-basis models catching up only as the training set grows. Learned exponents provide an interpretable, relative signal: at a fixed initialisation they reveal a consistent, target-dependent geometric ordering across equation families and input dimensions.

神经网络符号回归可解释性几何学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。