arXiv:2410.11323cs.LGq-bio.QM2024-10被引 4

用柯尔莫哥洛夫-阿诺德网络提升分子性质预测的精度与效率

KA-GNN: Kolmogorov-Arnold Graph Neural Networks for Molecular Property Prediction

  • 用KAN替代传统GNN的节点嵌入、消息传递和读出层
  • 在7个基准数据集上优于主流GNN模型,且计算更快
  • 提出傅里叶KAN模块,数学证明其强逼近能力

作为几何深度学习的关键模型,图神经网络在分子数据分析中展现出巨大潜力。最近,一种特殊设计的学习架构——柯尔莫哥洛夫-阿诺德网络(KAN)在提升模型精度、效率和可解释性方面显示出独特优势。本文首次提出基于KAN的图神经网络(KA-GNN),包括基于KAN的图卷积网络(KA-GCN)和基于KAN的图注意力网络(KA-GAT)。核心思想是利用KAN在节点嵌入、消息传递和读出三个关键层面优化GNN结构。此外,借助傅里叶级数的强大逼近能力,我们构建了基于傅里叶的KAN模型,并严格证明了该傅里叶KAN架构的鲁棒逼近性能。为验证效果,我们在七个最常用的分子性质预测基准数据集上广泛对比现有先进模型。结果表明,我们的KA-GNN显著优于传统GNN,尤其傅里叶KAN模块不仅提升精度,还降低计算时间。本工作不仅凸显了KA-GNN在分子性质预测中的强大能力,也为非欧几里得数据的一般分析提供了新颖的几何深度学习框架。

原文摘要 · Abstract (English)

As key models in geometric deep learning, graph neural networks have demonstrated enormous power in molecular data analysis. Recently, a specially-designed learning scheme, known as Kolmogorov-Arnold Network (KAN), shows unique potential for the improvement of model accuracy, efficiency, and explainability. Here we propose the first non-trivial Kolmogorov-Arnold Network-based Graph Neural Networks (KA-GNNs), including KAN-based graph convolutional networks(KA-GCN) and KAN-based graph attention network (KA-GAT). The essential idea is to utilizes KAN's unique power to optimize GNN architectures at three major levels, including node embedding, message passing, and readout. Further, with the strong approximation capability of Fourier series, we develop Fourier series-based KAN model and provide a rigorous mathematical prove of the robust approximation capability of this Fourier KAN architecture. To validate our KA-GNNs, we consider seven most-widely-used benchmark datasets for molecular property prediction and extensively compare with existing state-of-the-art models. It has been found that our KA-GNNs can outperform traditional GNN models. More importantly, our Fourier KAN module can not only increase the model accuracy but also reduce the computational time. This work not only highlights the great power of KA-GNNs in molecular property prediction but also provides a novel geometric deep learning framework for the general non-Euclidean data analysis.

图神经网络分子预测KAN几何深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。