用可学习的滤波器形状替代传统卷积,实现高效高精度模型。
Structural Kolmogorov-Arnold Convolutions: Learnable Function on the Values or the Filter Shape as Parameter-Efficient Alternative to Per-Edge Convolutional KANs

- 将可学习函数置于滤波器结构而非像素值,提升参数效率
- 在CIFAR-10/100上达88.47%/64.40%准确率,仅需0.4M参数
- 适合追求轻量化且高表达力的视觉模型研究者
卷积型Kolmogorov-Arnold网络(KAN)用可学习的一维函数替代卷积核的固定权重。主流方法为每个核元素配置一个作用于像素值的函数,虽表达能力强但参数量大且易过拟合。本文提出将可学习函数置于卷积结构中,沿“函数作用于像素值还是滤波器形状”这一维度设计新架构。研究三种实现:SV-KAN共享一函数处理像素值,滤波器静态;AG-KAN使用内容自适应高斯门控制空间结构;RF-KAN则将函数置于滤波器形状,通过局部振荡(Morlet)小波基构建方向性脊状滤波器并自适应调整振幅。在四层匹配协议下,RF-KAN与SV-KAN在CIFAR-10上分别达到88.47±0.10%和88.20±0.31%,在CIFAR-100上分别为64.40±0.19%和64.57±0.30%,参数量约0.4M。在此规模下,形状模型与最简值模型性能相当,均优于普通卷积与所有测试过的逐边KAN(包括官方Gram变体),参数仅为后者的五分之一。控制实验表明,性能提升源于局域振荡基与内容自适应性;移除学习的形状仅保留共享值函数,准确率下降超40点,证明学习形状是核心关键。
原文摘要 · Abstract (English)
Convolutional Kolmogorov--Arnold Networks (KANs) replace the fixed weights of a convolutional kernel with learnable univariate functions. The dominant formulation attaches one such function to every kernel entry and lets it act on pixel values, expressive but parameter-heavy and prone to overfitting. We argue that the learnable functions are better placed in the \emph{structure} of the convolution than on each edge, and we organise the design space along a single axis: whether the function acts on the pixel \emph{values} or on the filter \emph{shape}. We study three realisations. SV-KAN applies one shared univariate function to the values and leaves the spatial filter free and static, aa classical convolution with a single learnable shared activation. AG-KAN keeps the shared value function but supplies the spatial structure through a content-adaptive Gaussian gate. RF-KAN instead moves the learnable functions onto the filter shape, building each filter from oriented ridge profiles expanded in a localised oscillatory (Morlet) wavelet basis with content-adaptive amplitudes. Under a matched four-layer protocol with in-run references and three seeds, RF-KAN and SV-KAN reach $88.47\pm0.10\%$ and $88.20\pm0.31\%$ on CIFAR-10 and $64.40\pm0.19\%$ and $64.57\pm0.30\%$ on CIFAR-100, at about $0.4$M parameters. At this matched scale the shape model and the simplest value model meet at the top, both above a plain convolution and every per-edge KAN we tested, including the official Gram variant, at roughly a fifth of the parameters. A controlled study attributes the RF-KAN gain to an intrinsically localised oscillatory basis and to content adaptivity, and an ablation that removes the learned shape entirely, leaving only the shared value function, collapses accuracy by over forty points, identifying the learned shape as the load-bearing ingredient at this scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。