arXiv:2608.01490cs.LG2026-08

二值化KAN会破坏函数空间,BiKAN通过引入沃尔什基修复了这一问题。

BiKAN: Restoring Collapsed Basis of Binary Kolmogorov--Arnold Networks

论文配图:BiKAN: Restoring Collapsed Basis of Binary Kolmogorov--Arnold Networks
图 1 · 摘自论文原文
  • 用沃尔什基补充二值KAN层,恢复高阶特征表达能力
  • 在相同参数量下,精度比传统拓宽高3.09点,且宽度越小优势越大
  • 硬件部署高效,FPGA计算延迟降低86%,功耗几乎为零

将多项式柯尔莫戈罗夫-阿诺德网络(KAN)二值化不仅改变参数精度,还改变了每层可用的函数空间。当激活值被限制为{-1,+1}时,所有偶次幂变为1,奇次幂变为x,导致逐元素多项式基函数坍缩为常数和一阶响应。我们称此结构失效为空间正交性坍缩。本文提出的BiKAN通过在每个二值KAN层中引入选定的二阶沃尔什特征来解决这一关键问题。固定循环通道移位生成成对奇偶性,学习到的二进制投影使用与其余W1A1路径相同的XNOR-popcount操作混合它们,从而在无需学习路由或乘法器型特征生成的情况下恢复显式的成对坐标。在CIFAR-10上的实验表明,移除奇偶性会导致五组种子下准确率下降1.23点(p=0.003),且随着网络宽度减小,增益更显著,添加更多奇偶平面时准确率单调提升。在约1190万参数预算下,奇偶性相比传统拓宽提升3.09点(p<10^-4)。在W1A1设置下,BiKAN在MNIST、CIFAR-10和CIFAR-100上分别达到99.48%、84.38%和55.81%的准确率。后路由Zynq-7020 FPGA结果表明,修复仍具硬件效率:卷积设计将DSP使用从164降至72,估算计算核心延迟从401毫秒降至54.8毫秒;而幂次感知密集设计实现零DSP推理,仅损失0.03点准确率。BiKAN实现代码已开源:https://github.com/OSU-STARLAB/BiKAN。

原文摘要 · Abstract (English)

Binarizing a polynomial Kolmogorov--Arnold Network (KAN) not only changes parameter precision, but also alters the function space available to each layer. When activations are restricted to ${-1,+1}$, all even powers reduce to $1$ and all odd powers reduce to $x$, causing the elementwise polynomial basis to collapse to constant and first-order responses. We refer to this structural failure as Spatial Orthogonality Collapse. Our proposed BiKAN addresses this critical issue by augmenting each binary KAN layer with selected degree-2 Walsh characters. Fixed circular channel rolls generate pairwise parities, and learned binary projections mix them using the same XNOR--popcount operations as the remaining W1A1 paths. This restores explicit pairwise coordinates without learned routing or multiplier-based feature generation. Experiments on CIFAR-10 confirms that removing parity reduces accuracy by $1.23$ points over five paired seeds ($p=0.003$), the gain increases as width decreases, and accuracy improves monotonically as more parity planes are added. At an equal $\sim$11.9M-parameter budget, parity outperforms conventional widening by $3.09$ points ($p<10^{-4}$). At W1A1, BiKAN reaches $99.48\%$, $84.38\%$, and $55.81\%$ on MNIST, CIFAR-10, and CIFAR-100, respectively. Post-route Zynq-7020 FPGA results show that the repair remains hardware-efficient; the convolutional design cuts DSP usage from 164 to 72 and estimated compute-core latency from 401 to 54.8 ms, while the power-of-two-aware dense design achieves zero-DSP inference with a 0.03-point accuracy loss. The BiKAN implementation is available at https://github.com/OSU-STARLAB/BiKAN.

二值化KAN沃尔什基硬件优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。