arXiv:2410.10084cs.CVcs.LG2024-10被引 44

用KAN替代MLP,让点云分类分割更高效

PointNet with KAN versus PointNet with MLP for 3D Classification and Segmentation of Point Sets

论文配图:PointNet with KAN versus PointNet with MLP for 3D Classification and Segmentation of Point Sets
图 1 · 摘自论文原文
  • 用KAN替代传统MLP,可学习激活函数
  • 在相同架构下性能媲美甚至超越原版PointNet
  • 适合想尝试新型神经网络结构的研究者

Kolmogorov-Arnold Networks(KAN)作为深度学习中传统多层感知机(MLP)的替代方案,已在卷积神经网络、图神经网络和Transformer等架构中得到应用与评估。然而,其在基于点云的神经网络中的有效性尚不明确。为此,本文首次将KAN引入PointNet,提出PointNet-KAN模型,用于3D点云分类与分割任务。该模型采用共享的KAN层并结合对称函数提取全局特征,保持输入顺序无关性。与传统MLP训练权重不同,KAN通过训练激活函数本身实现建模。本研究使用雅可比多项式构建KAN层,并系统评估了不同多项式阶数及特殊类型(拉格朗日、切比雪夫、盖根鲍尔)的表现。实验结果表明,尽管网络结构更浅更简单,PointNet-KAN在多个基准数据集上的分类与部分/语义分割任务中表现与标准PointNet相当甚至更优。此外,还探索了混合使用KAN与MLP的融合模型,为未来将KAN集成到更复杂的点云处理架构中提供参考。

原文摘要 · Abstract (English)

Kolmogorov-Arnold Networks (KANs) have recently gained attention as an alternative to traditional Multilayer Perceptrons (MLPs) in deep learning frameworks. KANs have been integrated into various deep learning architectures such as convolutional neural networks, graph neural networks, and transformers, with their performance evaluated. However, their effectiveness within point-cloud-based neural networks remains unexplored. To address this gap, we incorporate KANs into PointNet for the first time to evaluate their performance on 3D point cloud classification and segmentation tasks. Specifically, we introduce PointNet-KAN, built upon two key components. First, it employs KANs instead of traditional MLPs. Second, it retains the core principle of PointNet by using shared KAN layers and applying symmetric functions for global feature extraction, ensuring permutation invariance with respect to the input features. In traditional MLPs, the goal is to train the weights and biases with fixed activation functions; however, in KANs, the goal is to train the activation functions themselves. We use Jacobi polynomials to construct the KAN layers. We extensively and systematically evaluate PointNet-KAN across various polynomial degrees and special types such as the Lagrange, Chebyshev, and Gegenbauer polynomials. Our results show that PointNet-KAN achieves competitive performance compared to PointNet with MLPs on benchmark datasets for 3D object classification and part and semantic segmentation, despite employing a shallower and simpler network architecture. We also study a hybrid PointNet model incorporating both KAN and MLP layers. We hope this work serves as a foundation and provides guidance for integrating KANs, as an alternative to MLPs, into more advanced point cloud processing architectures.

点云处理KAN神经网络分类分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。