FEKAN提升KAN网络效率与精度,不增参数量
FEKAN: Feature-Enriched Kolmogorov-Arnold Networks
- 在KAN中引入特征增强,保持可解释性同时加速训练
- 函数逼近任务中收敛速度更快,准确率显著高于基线
- 适合需要高效高精度建模的科研与工程应用
Kolmogorov-Arnold网络(KAN)作为多层感知机的替代方案,凭借函数分解实现了更高可解释性。然而现有KAN架构(如样条、小波、径向基等)存在计算成本高、收敛慢的问题,限制了其可扩展性和实用性。本文提出特征增强型KAN(FEKAN),在不增加可训练参数的前提下,通过引入额外特征,显著提升计算效率与预测精度。该方法加速收敛、增强表达能力,并大幅降低当前先进KAN架构的计算开销。我们在多项基准任务上验证了FEKAN,包括函数逼近、多种偏微分方程(PDEs)的物理信息建模,以及神经算子映射输入输出函数空间。在函数逼近任务中,系统对比了包括FastKAN、WavKAN、ReLUKAN、HRKAN、ChebyshevKAN、RBFKAN和原始SplineKAN在内的多个变体。结果表明,所有任务下FEKAN均实现更快收敛与更优近似精度。我们还建立了理论基础,证明FEKAN的表达能力优于传统KAN,从而带来更高的准确率与效率。
原文摘要 · Abstract (English)
Kolmogorov-Arnold Networks (KANs) have recently emerged as a compelling alternative to multilayer perceptrons, offering enhanced interpretability via functional decomposition. However, existing KAN architectures, including spline-, wavelet-, radial-basis variants, etc., suffer from high computational cost and slow convergence, limiting scalability and practical applicability. Here, we introduce Feature-Enriched Kolmogorov-Arnold Networks (FEKAN), a simple yet effective extension that preserves all the advantages of KAN while improving computational efficiency and predictive accuracy through feature enrichment, without increasing the number of trainable parameters. By incorporating these additional features, FEKAN accelerates convergence, increases representation capacity, and substantially mitigates the computational overhead characteristic of state-of-the-art KAN architectures. We investigate FEKAN across a comprehensive set of benchmarks, including function-approximation tasks, physics-informed formulations for diverse partial differential equations (PDEs), and neural operator settings that map between input and output function spaces. For function approximation, we systematically compare FEKAN against a broad family of KAN variants, FastKAN, WavKAN, ReLUKAN, HRKAN, ChebyshevKAN, RBFKAN, and the original SplineKAN. Across all tasks, FEKAN demonstrates substantially faster convergence and consistently higher approximation accuracy than the underlying baseline architectures. We also establish the theoretical foundations for FEKAN, showing its superior representation capacity compared to KAN, which contributes to improved accuracy and efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。