KAN网络提升科学机器学习的建模能力,解决传统神经网络的可解释性与精度难题。
Scientific Machine Learning with Kolmogorov-Arnold Networks
- 用可学习的激活函数替代固定形式,增强模型对复杂非线性关系的表达力。
- 在多个任务中实现更高精度、更快收敛和更优频谱表征,优于传统MLP。
- 适合需要高可解释性与物理一致性建模的科研场景,如流体模拟与材料预测。
科学机器学习最初依赖多层感知机(MLPs),但其存在可解释性差、激活函数固定、难以捕捉局部或高频特征等问题。近年来,柯尔莫哥洛夫-阿诺德网络(KANs)逐渐取代MLPs,因其具备更高的可解释性和灵活性,能更高效地建模复杂非线性交互,并克服传统MLP架构的局限性。本文从三个视角综述了基于KAN的模型进展:(i) 数据驱动学习,(ii) 物理信息建模,(iii) 深度算子学习。通过架构设计、训练策略、应用效果及与MLP的对比评估,揭示了KAN在准确性、收敛速度和频谱表示上的持续优势,说明其在学习复杂动力学方面更具效能。此外,本文还提供了多项对比分析,阐明KAN建模的核心特性,并展望其在实际应用中的潜力。最后,识别出当前关键挑战:计算效率、理论保证、超参数调优与算法复杂度,并提出未来研究方向,旨在提升KAN框架的鲁棒性、可扩展性与物理一致性。
原文摘要 · Abstract (English)
The field of scientific machine learning, which originally utilized multilayer perceptrons (MLPs), is increasingly adopting Kolmogorov-Arnold Networks (KANs) for data encoding. This shift is driven by the limitations of MLPs, including poor interpretability, fixed activation functions, and difficulty capturing localized or high-frequency features. KANs address these issues with enhanced interpretability and flexibility, enabling more efficient modeling of complex nonlinear interactions and effectively overcoming the constraints associated with conventional MLP architectures. This review categorizes recent progress in KAN-based models across three distinct perspectives: (i) data-driven learning, (ii) physics-informed modeling, and (iii) deep-operator learning. Each perspective is examined through the lens of architectural design, training strategies, application efficacy, and comparative evaluation against MLP-based counterparts. By benchmarking KANs against MLPs, we highlight consistent improvements in accuracy, convergence, and spectral representation, clarifying KANs' advantages in capturing complex dynamics while learning more effectively. In addition to reviewing recent literature, this work also presents several comparative evaluations that clarify central characteristics of KAN modeling and hint at their potential implications for real-world applications. Finally, this review identifies critical challenges and open research questions in KAN development, particularly regarding computational efficiency, theoretical guarantees, hyperparameter tuning, and algorithm complexity. We also outline future research directions aimed at improving the robustness, scalability, and physical consistency of KAN-based frameworks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。