arXiv:2504.13593cs.CV2025-04被引 6

用KAN替代MLP,让点云模型更高效地捕捉几何特征。

KAN or MLP? Point Cloud Shows the Way Forward

  • 引入几何仿射模块与并行局部处理结构,增强对局部几何的建模能力。
  • 在多个基准数据集上超越PointMLP,少样本学习表现尤其出色。
  • 提出高效KAN变体,参数量和计算量显著降低,适合实际部署。

多层感知机(MLPs)在点云分析中因其有效的特征学习机制成为基础组件。然而,在处理复杂几何结构时,固定激活函数难以高效捕捉局部几何特征,且存在参数效率低、模型冗余问题。本文提出PointKAN,将科尔莫戈罗夫-阿诺德网络(KANs)应用于点云分析,探索其在层级特征表示中的有效性。首先引入几何仿射模块(GAM)转换局部特征,提升对几何变化的鲁棒性;其次在局部特征处理(LFP)中采用并行结构,同时提取组级特征与全局上下文,丰富细粒度与整体结构表征;最后通过全局特征处理(GFP)融合并迭代处理,逐步扩展感受野,完整捕捉点云几何信息。为克服标准KAN参数量大、计算效率低的问题,设计了PointKAN-elite中的高效KAN,显著减少参数量同时保持精度。实验表明,PointKAN在ModelNet40、ScanObjectNN、ShapeNetPart等基准数据集上优于PointMLP,尤其在少样本学习任务中表现突出,并大幅降低参数量与计算复杂度(FLOPs)。该工作揭示了基于KAN架构在三维视觉中的潜力,为点云理解开辟新路径。

原文摘要 · Abstract (English)

Multi-Layer Perceptrons (MLPs) have become one of the fundamental architectural component in point cloud analysis due to its effective feature learning mechanism. However, when processing complex geometric structures in point clouds, MLPs' fixed activation functions struggle to efficiently capture local geometric features, while suffering from poor parameter efficiency and high model redundancy. In this paper, we propose PointKAN, which applies Kolmogorov-Arnold Networks (KANs) to point cloud analysis tasks to investigate their efficacy in hierarchical feature representation. First, we introduce a Geometric Affine Module (GAM) to transform local features, improving the model's robustness to geometric variations. Next, in the Local Feature Processing (LFP), a parallel structure extracts both group-level features and global context, providing a rich representation of both fine details and overall structure. Finally, these features are combined and processed in the Global Feature Processing (GFP). By repeating these operations, the receptive field gradually expands, enabling the model to capture complete geometric information of the point cloud. To overcome the high parameter counts and computational inefficiency of standard KANs, we develop Efficient-KANs in the PointKAN-elite variant, which significantly reduces parameters while maintaining accuracy. Experimental results demonstrate that PointKAN outperforms PointMLP on benchmark datasets such as ModelNet40, ScanObjectNN, and ShapeNetPart, with particularly strong performance in Few-shot Learning task. Additionally, PointKAN achieves substantial reductions in parameter counts and computational complexity (FLOPs). This work highlights the potential of KANs-based architectures in 3D vision and opens new avenues for research in point cloud understanding.

点云分析KAN神经网络架构高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。