arXiv:2511.18689cs.LG2025-11被引 3

首个统一量化框架,让KAN网络在低精度下高效运行。

QuantKAN: A Unified Quantization Framework for Kolmogorov Arnold Networks

  • 为KAN设计分枝感知量化器,适配不同参数类型
  • 在多个数据集上实现4位权重、4位激活的高效推理
  • 适合关注低精度部署与硬件优化的研究者

Kolmogorov--Arnold网络(KANs)用基于样条的函数替代线性权重,具备强表达能力,但因参数分布异质性,难以进行低精度部署。我们提出QuantKAN,首个支持量化感知训练(QAT)和训练后量化(PTQ)的统一框架。该框架采用分枝感知量化器处理基础参数与样条参数,并将现代QAT与PTQ方法扩展至EfficientKAN、FastKAN、PyKAN和KAGN中的样条层。在MNIST、CIFAR-10/100、TinyImageNet和ImageNet上的实验首次建立了统一的KAN量化基准。结果表明,在极端低比特设置下,DSQ是最鲁棒的QAT方法;在中等精度下,GPTQ表现最佳。敏感性分析显示:FastKAN中样条/基函数参数主导性能退化,而EfficientKAN、GRAM和PyKAN中基础或缩放参数更关键。Vivado HLS在Xilinx UltraScale+设备上的估计显示,W4A4下吞吐提升达3.32倍,动态功耗降低7.7倍,揭示出残余的‘基函数评估开销’,推动基于基函数感知的微架构设计。代码已开源。

原文摘要 · Abstract (English)

Kolmogorov--Arnold Networks (KANs) replace linear weights with spline-based functions, offering strong expressivity but posing challenges for low-precision deployment due to heterogeneous parameter distributions. We introduce QuantKAN, the first unified framework for quantization-aware training (QAT) and post-training quantization (PTQ) of KANs. The framework employs branch-aware quantizers for base and spline parameters and extends modern QAT and PTQ methods to spline-based layers across EfficientKAN, FastKAN, PyKAN, and KAGN. Experiments on MNIST, CIFAR-10/100, TinyImageNet, and ImageNet provide the first unified QAT/PTQ KAN benchmarks and show that DSQ is the most robust QAT method at aggressive low-bit settings, while GPTQ is the strongest PTQ method at moderate precision. Sensitivity analyses reveal architecture-specific failure modes: spline/basis parameters dominate in FastKAN, while base or scaling parameters dominate in EfficientKAN, GRAM, and PyKAN. Vivado HLS estimates on a Xilinx UltraScale+ device further suggest up to 3.32$\times$ throughput and 7.7$\times$ lower estimated dynamic energy per inference under W4A4, exposing a residual \emph{basis-evaluation tax} that motivates basis-aware microarchitecture. QuantKAN is available at https://github.com/OSU-STARLAB/QuantKAN/.

KAN量化低精度硬件优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。