arXiv:2512.00055cs.ARcs.AI2025-12被引 3

提出KAN-SAs加速器,让可解释的KAN网络在硬件上更高效运行。

KAN-SAs: Efficient Acceleration of Kolmogorov-Arnold Networks on Systolic Arrays

  • 利用B样条非递归实现与KAN稀疏性提升流水线利用率
  • 相比传统架构,最高提升100%硬件利用率,时钟周期减少50%
  • 适合需要高能效与可解释性的AI推理场景

Kolmogorov-Arnold网络(KANs)因其参数效率和可解释性优于传统深度神经网络(DNNs)而受到关注。KANs的核心创新在于使用可学习的非线性激活函数,以样条形式参数化。样条由基函数(B-样条)的线性组合表示,但其递归定义使加速困难。流水线阵列(SA)因能效高、延迟低,是理想的DNN加速架构,但其对KAN的适用性尚未评估。本文探索用SA加速KAN推理,发现其利用率仅30%。为此提出KAN-SAs,通过引入非递归的B-样条实现并利用KAN内在稀疏性,显著提升常规SA效率。硬件合成结果表明,在28nm FD-SOI工艺下,KAN-SAs可实现高达100%的SA利用率,并比同面积的传统SA减少50%时钟周期。不同配置在多种KAN应用上的评估验证了其推理效率的提升。

原文摘要 · Abstract (English)

Kolmogorov-Arnold Networks (KANs) have garnered significant attention for their promise of improved parameter efficiency and explainability compared to traditional Deep Neural Networks (DNNs). KANs' key innovation lies in the use of learnable non-linear activation functions, which are parametrized as splines. Splines are expressed as a linear combination of basis functions (B-splines). B-splines prove particularly challenging to accelerate due to their recursive definition. Systolic Array (SA)based architectures have shown great promise as DNN accelerators thanks to their energy efficiency and low latency. However, their suitability and efficiency in accelerating KANs have never been assessed. Thus, in this work, we explore the use of SA architecture to accelerate the KAN inference. We show that, while SAs can be used to accelerate part of the KAN inference, their utilization can be reduced to 30%. Hence, we propose KAN-SAs, a novel SA-based accelerator that leverages intrinsic properties of B-splines to enable efficient KAN inference. By including a nonrecursive B-spline implementation and leveraging the intrinsic KAN sparsity, KAN-SAs enhances conventional SAs, enabling efficient KAN inference, in addition to conventional DNNs. KAN-SAs achieves up to 100% SA utilization and up to 50% clock cycles reduction compared to conventional SAs of equivalent area, as shown by hardware synthesis results on a 28nm FD-SOI technology. We also evaluate different configurations of the accelerator on various KAN applications, confirming the improved efficiency of KAN inference provided by KAN-SAs.

KAN硬件加速流水线阵列样条网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。