用归一化高斯基函数提升KAN的稳定性和精度
Partition-of-Unity Gaussian Kolmogorov-Arnold Networks

- 采用局部归一化高斯基,实现分片单位分解结构
- 显著降低对超参数ε的敏感性,验证准确率提升
- 适合需要稳定训练的光滑及中等非光滑问题
高斯基函数为KAN中的样条激活提供了一种高效灵活的替代方案。本文提出分片单位高斯KAN(PU-GKAN),一种基于Shepard归一化的高斯KAN,其中每条边上的高斯基值除以其固定中心的局部和,生成具有可训练系数的分片单位特征映射,同时保持标准边基KAN结构。该归一化构造在边级别实现常数精确再现,并支持显式的有限特征核解释。从有限特征与可加核视角,我们统一表述标准高斯KAN(GKAN)与PU-GKAN,使诱导层核与经验特征矩阵显式化。以第一层特征矩阵为参考,采用实际尺度选择区间ε,下限由相邻中心重叠决定,上限由保守条件阈值确定。数值实验表明,PU-GKAN降低了对ε的敏感性,提升了大多数光滑及中等非光滑目标的验证准确率,并带来更稳定的训练行为。该优势在样本量与中心数变化、高维架构、Matérn RBF基函数以及涉及赫尔姆霍兹方程和波动方程的物理信息示例中持续存在。结果表明,Shepard型分片单位归一化是RBF基KAN的一种简单而有效的稳定机制。
原文摘要 · Abstract (English)
Gaussian basis functions provide an efficient and flexible alternative to spline activations in KANs. In this work, we introduce the partition-of-unity Gaussian KAN (PU-GKAN), a Shepard-type normalized Gaussian KAN in which the Gaussian basis values on each edge are divided by their local sum over fixed centers. This produces a partition-of-unity feature map with trainable coefficients, while preserving the standard edge-based KAN structure. The normalized construction gives exact constant reproduction at the edge level and admits an explicit finite-feature kernel interpretation. We formulate both the standard Gaussian KAN (GKAN) and PU-GKAN from a finite-feature and additive-kernel viewpoint, making the induced layer kernels and empirical feature matrices explicit. Using the first-layer feature matrix as the reference object, we adopt a practical scale-selection interval for \(ε\), with the lower endpoint determined by adjacent-center overlap and the upper endpoint determined by a conservative conditioning threshold. Numerical experiments show that PU-GKAN reduces sensitivity to \(ε\), improves validation accuracy for most smooth and moderately non-smooth targets, and gives more stable training behavior. The benefit persists across sample-size and center-number sweeps, higher-dimensional architectures, Matérn RBF bases, and physics-informed examples involving Helmholtz and wave equations. These results indicate that Shepard-type partition-of-unity normalization is a simple and effective stabilization mechanism for RBF-based KANs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。