arXiv:2601.21541cs.CV2026-01被引 1

用柯尔莫哥洛夫网络设计无注意力视觉主干,线性复杂度下保持高精度。

Vision KAN: Towards an Attention-Free Backbone for Vision with Kolmogorov-Arnold Networks

  • 基于径向基函数的KAN实现分块非线性混合,替代传统注意力
  • 在ImageNet-1K上达到与注意力模型相当的准确率,复杂度为线性
  • 适合追求高效、可解释视觉模型的研究者和工程落地场景

注意力机制因能建模长程依赖而成为现代视觉主干的关键模块,但其序列长度的二次复杂度及注意力权重难以解释,限制了可扩展性和清晰性。近期无注意力架构表明,无需成对注意力也可获得强性能,推动寻找替代方案。本文提出视觉柯尔莫哥洛夫网络(ViK),一种受柯尔莫哥洛夫-阿诺德网络启发的无注意力主干。核心为多块径向基函数KAN(MultiPatch-RBFKAN),融合:(a) 基于径向基函数的分块非线性变换,(b) 轴向可分离混合以实现高效局部传播,(c) 低秩全局映射用于长程交互。作为注意力模块的即插即用替代,该结构通过分块分组策略与轻量级算子,缓解高分辨率特征上全量KAN的计算瓶颈,恢复跨块依赖。ImageNet-1K实验表明,ViK以线性复杂度实现竞争力准确率,验证了基于KAN的标记混合在效率与理论基础上优于注意力的潜力。

原文摘要 · Abstract (English)

Attention mechanisms have become a key module in modern vision backbones due to their ability to model long-range dependencies. However, their quadratic complexity in sequence length and the difficulty of interpreting attention weights limit both scalability and clarity. Recent attention-free architectures demonstrate that strong performance can be achieved without pairwise attention, motivating the search for alternatives. In this work, we introduce Vision KAN (ViK), an attention-free backbone inspired by the Kolmogorov-Arnold Networks. At its core lies MultiPatch-RBFKAN, a unified token mixer that combines (a) patch-wise nonlinear transform with Radial Basis Function-based KANs, (b) axis-wise separable mixing for efficient local propagation, and (c) low-rank global mapping for long-range interaction. Employing as a drop-in replacement for attention modules, this formulation tackles the prohibitive cost of full KANs on high-resolution features by adopting a patch-wise grouping strategy with lightweight operators to restore cross-patch dependencies. Experiments on ImageNet-1K show that ViK achieves competitive accuracy with linear complexity, demonstrating the potential of KAN-based token mixing as an efficient and theoretically grounded alternative to attention.

视觉主干无注意力KAN线性复杂度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。