arXiv:2410.02077cs.LGcs.AI2024-10被引 13

用新型神经网络结构提升数据重构效果,兼具精度与可解释性。

Kolmogorov-Arnold Network Autoencoders

  • 将激活函数置于边而非节点,基于柯尔莫哥洛夫定理设计新网络结构
  • 在MNIST、SVHN、CIFAR-10上实现与CNN相当的重构精度
  • 适合关注模型可解释性与结构创新的研究者

深度学习模型已革新多个领域,多层感知机(MLPs)是数据回归与图像分类的核心工具。近期研究提出柯尔莫哥洛夫-阿诺德网络(KANs),作为MLPs的有前景替代方案,其将激活函数置于边而非节点上。这一结构变化使KANs更契合柯尔莫哥洛夫-阿诺德表示定理,有望同时提升模型准确率与可解释性。本研究探索了KAN在自编码器中的表现,对比其在MNIST、SVHN和CIFAR-10数据集上与传统卷积神经网络(CNNs)的性能。结果表明,基于KAN的自编码器在重构准确率方面表现具有竞争力,验证了其在数据分析任务中的可行性。

原文摘要 · Abstract (English)

Deep learning models have revolutionized various domains, with Multi-Layer Perceptrons (MLPs) being a cornerstone for tasks like data regression and image classification. However, a recent study has introduced Kolmogorov-Arnold Networks (KANs) as promising alternatives to MLPs, leveraging activation functions placed on edges rather than nodes. This structural shift aligns KANs closely with the Kolmogorov-Arnold representation theorem, potentially enhancing both model accuracy and interpretability. In this study, we explore the efficacy of KANs in the context of data representation via autoencoders, comparing their performance with traditional Convolutional Neural Networks (CNNs) on the MNIST, SVHN, and CIFAR-10 datasets. Our results demonstrate that KAN-based autoencoders achieve competitive performance in terms of reconstruction accuracy, thereby suggesting their viability as effective tools in data analysis tasks.

神经网络自编码器可解释性结构创新

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。