arXiv:2604.21174cs.CEcs.AI2026-04被引 2

提出高斯KAN的稳定尺度选择方法,提升模型准确性和可靠性。

Making Gaussian Kolmogorov-Arnold Networks Reliable and Accurate

  • 基于第一层特征矩阵的几何与条件分析,确定最优尺度区间
  • 实验证明该区间在不同任务和维度下均保持稳定性能
  • 适用于固定尺度、可变尺度及高效超参搜索,是核心设计原则

Kolmogorov-Arnold网络(KANs)用可学习的单变量边函数替代固定激活函数,其表现依赖于基函数选择。高斯径向基函数作为样条的简洁高效替代,其精度与稳定性对尺度参数ε高度敏感,但此前缺乏系统研究。本文通过分析第一层特征矩阵的几何结构与条件数,发现该层输入域直接定义导致特征可区分性损失会传播至全网。据此提出实用操作区间ε∈[1/(G-1), 2/(G-1)],其中G为高斯中心数,此区间作为稳定设计准则而非普适最优。在函数逼近与物理信息问题上的大量实验验证了其在不同采样密度、网格分辨率、网络结构及输入维度下的可靠性。同时证明该原则可支持固定尺度选择、可变尺度模型、ε的约束优化及利用早期训练误差实现高效尺度搜索。结果确立尺度选择为构建可靠、精确高斯KAN的核心设计原则。

原文摘要 · Abstract (English)

Kolmogorov-Arnold Networks (KANs) replace fixed activations with learnable univariate edge functions whose behavior depends strongly on the chosen basis. Gaussian radial basis functions provide a simple and efficient alternative to splines, but their accuracy and stability are highly sensitive to the scale parameter \(ε\), which has not been studied systematically. We analyze this dependence through the geometry and conditioning of the first-layer feature matrix. Because the first layer is defined directly on the input domain, any loss of feature distinguishability introduced there propagates through the entire network. Based on this analysis, we identify the practical operating interval \[ ε\in \left[\frac{1}{G-1},\frac{2}{G-1}\right], \] where \(G\) is the number of Gaussian centers. This interval is proposed as a stable design rule rather than a universal optimum. Extensive experiments on function approximation and physics-informed problems confirm its reliability across different collocation densities, grid resolutions, architectures, and input dimensions. We also show how the same principle supports fixed-scale selection, variable-scale models, constrained optimization of \(ε\), and efficient scale search using early-stage training error. These results establish scale selection as a central design principle for reliable and accurate Gaussian KANs.

KAN神经网络高斯基函数尺度选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。