arXiv:2605.21534stat.MLcs.LG2026-05

用自适应核参数提升RBF-KAN性能,让模型更灵活高效。

Adaptive RBF-KAN: A Comparative Evaluation of Dynamic Shape Parameters in Kolmogorov-Arnold Networks

论文配图:Adaptive RBF-KAN: A Comparative Evaluation of Dynamic Shape Parameters in Kolmogorov-Arnold Networks
图 1 · 摘自论文原文
  • 引入多种径向基核并动态调整形状参数
  • 基于留一法交叉验证初始化核尺度,提升训练效率
  • 适合需要高精度函数逼近的科研与工程场景

Kolmogorov-Arnold网络(KANs)通过可学习的一维边函数近似多变量函数,传统方法使用B样条基,计算开销大。为提高效率,FastKAN改用高斯径向基函数(RBF),但依赖固定核和形状参数。本文首次将留一法交叉验证(LOOCV)用于KAN训练中核尺度的初始化,并首次在KAN框架中引入Matérn和Wendland核,实现比高斯核更灵活的基表示。LOOCV提供的数据驱动初始化在后续训练中进一步优化。在多个二维基准函数上的实验表明,不同核在光滑函数、间断点和振荡模式上各有优势。结合LOOCV初始化与自适应核学习,显著提升了RBF-KAN的性能与实用性。

原文摘要 · Abstract (English)

Kolmogorov-Arnold Networks (KANs) approximate multivariate functions using learnable univariate edge functions, typically parameterized by B-spline bases. Although effective, spline-based implementations can be computationally expensive. A modified version of KANs, called FastKAN, improves efficiency by replacing splines with Gaussian radial basis functions (RBFs), but it relies on a fixed kernel and shape parameter. In this work, we extend the RBF-based KAN framework by introducing a broader family of radial basis kernels and by initializing the kernel shape parameter using leave-one-out cross-validation (LOOCV). To the best of our knowledge, this is the first study that integrates LOOCV-based kernel scale estimation with deep KAN training. We also introduce Matérn and Wendland kernels into the KAN framework for the first time, enabling more flexible basis representations beyond the Gaussian kernel used in FastKAN. The LOOCV estimate provides a data-driven initialization of the kernel scale, which is subsequently refined during network training. The proposed adaptive RBF-KAN is evaluated on several two-dimensional benchmark functions. The results highlight the importance of kernel selection and adaptive shape parameters, with different kernels showing advantages for smooth functions, discontinuities, and oscillatory patterns. Overall, combining LOOCV-based initialization with adaptive kernel learning provides a practical strategy for improving RBF-based KAN models.

KANRBF函数逼近自适应核

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。