将数学定理融入卷积网络,实现更高效精准的图像分类。
KANICE: Kolmogorov-Arnold Networks with Interactive Convolutional Elements
- 用交互式卷积块与KAN线性层构建新架构,自适应提取特征。
- 在MNIST达99.35%准确率,SVHN达90.05%,优于基线模型。
- 推出轻量版KANICE-mini,参数减少九成仍保持高精度。
我们提出KANICE(带交互卷积单元的柯尔莫戈洛夫-阿诺德网络),一种结合卷积神经网络(CNN)与柯尔莫戈洛夫-阿诺德网络(KAN)原理的新架构。KANICE将交互式卷积块(ICBs)与KAN线性层融入CNN框架,利用KAN的通用逼近能力及ICB的自适应特征学习能力,捕捉复杂非线性数据关系,并实现基于柯尔莫戈洛夫-阿诺德表示定理的动态上下文感知特征提取。我们在四个数据集(MNIST、Fashion-MNIST、EMNIST、SVHN)上评估,对比标准CNN、CNN-KAN混合模型及ICB变体。KANICE始终表现更优,在MNIST上达99.35%准确率,SVHN上达90.05%。我们还提出紧凑型版本KANICE-mini,消融实验表明其性能接近原模型但参数显著减少:在SVHN上以2,337,828参数达到90.00%准确率,相较原版25,432,000参数大幅降低。本研究展示了基于KAN架构在图像分类中兼顾性能与效率的潜力,推动自适应神经网络与计算机视觉发展。代码已开源。
原文摘要 · Abstract (English)
We introduce KANICE (Kolmogorov-Arnold Networks with Interactive Convolutional Elements), a novel neural architecture that combines Convolutional Neural Networks (CNNs) with Kolmogorov-Arnold Network (KAN) principles. KANICE integrates Interactive Convolutional Blocks (ICBs) and KAN linear layers into a CNN framework. This leverages KANs' universal approximation capabilities and ICBs' adaptive feature learning. KANICE captures complex, non-linear data relationships while enabling dynamic, context-dependent feature extraction based on the Kolmogorov-Arnold representation theorem. We evaluated KANICE on four datasets: MNIST, Fashion-MNIST, EMNIST, and SVHN, comparing it against standard CNNs, CNN-KAN hybrids, and ICB variants. KANICE consistently outperformed baseline models, achieving 99.35% accuracy on MNIST and 90.05% on the SVHN dataset. Furthermore, we introduce KANICE-mini, a compact variant designed for efficiency. A comprehensive ablation study demonstrates that KANICE-mini achieves comparable performance to KANICE with significantly fewer parameters. KANICE-mini reached 90.00% accuracy on SVHN with 2,337,828 parameters, compared to KANICE's 25,432,000. This study highlights the potential of KAN-based architectures in balancing performance and computational efficiency in image classification tasks. Our work contributes to research in adaptive neural networks, integrates mathematical theorems into deep learning architectures, and explores the trade-offs between model complexity and performance, advancing computer vision and pattern recognition. The source code for this paper is publicly accessible through our GitHub repository (https://github.com/m-ferdaus/kanice).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。