arXiv:2509.20049cs.NEcs.AI2025-09

P-KAN通过熵最小化自动发现最优函数表示,实现模型压缩与可解释性提升。

Projective Kolmogorov Arnold Neural Networks (P-KANs): Entropy-Driven Functional Space Discovery for Interpretable Machine Learning

  • 用熵分析引导边函数向低参数投影空间(如傅里叶、切比雪夫)收敛
  • 相比标准KAN,参数减少达80%,抗噪能力显著增强
  • 适用于科学建模与工业预测,支持混合函数表示自动发现

Kolmogorov-Arnold网络(KANs)将可学习的非线性从节点转移到边,展现出在科学机器学习和可解释建模中的卓越能力。然而,现有KAN实现因高维样条参数空间中的冗余而存在根本性效率问题,大量不同参数化产生功能等价行为,形成模型雅可比矩阵中的“干扰空间”,导致过拟合和泛化性能差。本文提出投影式Kolmogorov-Arnold网络(P-KANs),一种新型训练框架,通过信号分析与稀疏字典学习中的熵最小化技术,引导边函数发现可解释的函数表示。不预设函数空间,而是保留样条灵活性,并引入“引力”项促使函数收敛至最优表示。关键洞察在于:通过投影系数的熵分析可识别最优表示,将边函数压缩至低参数投影空间(如傅里叶、切比雪夫、贝塞尔)。P-KANs在多个领域表现优异,实现最高80%的参数缩减,同时保持表征能力,对噪声鲁棒性显著优于标准KANs,成功应用于工业级自动化纤维铺设预测。该方法能自动发现混合函数表示,不同边收敛至不同最优空间,为科学机器学习提供压缩优势与更强可解释性。

原文摘要 · Abstract (English)

Kolmogorov-Arnold Networks (KANs) relocate learnable nonlinearities from nodes to edges, demonstrating remarkable capabilities in scientific machine learning and interpretable modeling. However, current KAN implementations suffer from fundamental inefficiencies due to redundancy in high-dimensional spline parameter spaces, where numerous distinct parameterisations yield functionally equivalent behaviors. This redundancy manifests as a "nuisance space" in the model's Jacobian, leading to susceptibility to overfitting and poor generalization. We introduce Projective Kolmogorov-Arnold Networks (P-KANs), a novel training framework that guides edge function discovery towards interpretable functional representations through entropy-minimisation techniques from signal analysis and sparse dictionary learning. Rather than constraining functions to predetermined spaces, our approach maintains spline space flexibility while introducing "gravitational" terms that encourage convergence towards optimal functional representations. Our key insight recognizes that optimal representations can be identified through entropy analysis of projection coefficients, compressing edge functions to lower-parameter projective spaces (Fourier, Chebyshev, Bessel). P-KANs demonstrate superior performance across multiple domains, achieving up to 80% parameter reduction while maintaining representational capacity, significantly improved robustness to noise compared to standard KANs, and successful application to industrial automated fiber placement prediction. Our approach enables automatic discovery of mixed functional representations where different edges converge to different optimal spaces, providing both compression benefits and enhanced interpretability for scientific machine learning applications.

可解释性神经网络压缩函数逼近KAN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。