ER-KAN在数据少、有噪声时表现更稳,比传统模型误差增长小得多。
ER-KANs: Efficient and Robust Kolmogorov-Arnold Networks for Data-Scarce Scientific Machine Learning

- 用共享高斯RBF基函数+训练时注入噪声+熵加权正则,提升抗噪能力
- 在噪声数据下,误差仅增长1.4倍,远低于MLP的7.9倍和ChebyKAN的10.6倍
- 适合科学计算中数据稀疏、含噪场景,如物理模拟与小样本建模
高效KAN研究几乎只在干净数据上评估,但我们在噪声数据下发现架构差异显著:当训练数据含σ=0.1噪声时,ChebyKAN测试均方误差(MSE)相比干净数据上升10.6倍,而原版KAN为7.9倍,标准MLP为1.7倍,本文提出的ER-KAN仅上升1.4倍。ER-KAN融合三项设计:层内共享高斯RBF基函数(提升局部性与参数效率)、训练中引入课程噪声(显式学习抗噪能力)、熵加权自适应正则化(防止小样本过拟合)。该模型仅595参数,在中等噪声下精度媲美MLP,且随噪声增加仍保持更平稳退化。我们在八组解析函数(N∈{50,200,500},σ∈{0,0.03,0.1})上验证,以及在阻尼谐振子物理信息神经网络中,ER-KAN解的MSE比MLP低4.2倍;在Burgers方程PINN中,所有模型均未收敛——我们如实报告此局限而非掩盖。提出噪声退化比作为补充评估指标,建议成为高效KAN论文的标准报告项。
原文摘要 · Abstract (English)
The efficient-KAN literature---covering Chebyshev, wavelet, and radial-basis-function variants of the original Kolmogorov-Arnold Network---has been benchmarked almost entirely on clean data. We show that this choice conceals a large capability difference between architectures: ChebyKAN's test MSE (evaluated against clean ground truth) increases by a factor of 10.6x when training data is corrupted with sigma=0.1 noise, versus 7.9x for vanilla KAN, 1.7x for a standard MLP, and just 1.4x for our proposed ER-KAN. ER-KAN combines three design choices targeting the noisy, data-scarce setting: shared Gaussian RBF bases across all edges in a layer (providing locality and efficient parameterisation), curriculum noise injection during training (explicitly teaching noise robustness), and entropy-weighted adaptive regularisation (preventing overfitting at small N). The result is a 595-parameter network that matches MLP accuracy at moderate noise while degrading far more gracefully as noise grows. We evaluate on eight analytic functions (N in {50, 200, 500}, sigma in {0, 0.03, 0.1}), on a damped harmonic oscillator physics-informed neural network where ER-KAN achieves 4.2x lower solution MSE than MLP, and on a Burgers' equation PINN where all models fail to converge---a genuine limitation we report rather than suppress. We introduce the noise degradation ratio as a simple complementary metric and recommend it become a standard reporting requirement for efficient-KAN papers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。