arXiv:2510.23501cs.LGphysics.comp-ph2025-10被引 8

改进深度物理信息神经网络训练稳定性,提升求解偏微分方程精度。

Training Deep Physics-Informed Kolmogorov-Arnold Networks

  • 提出无基底依赖的初始化方法,保持激活值方差稳定。
  • 设计残差门控自适应KAN结构,克服深层网络发散问题。
  • 在9个标准偏微分方程任务中显著优于现有模型,且更鲁棒。

自提出以来,柯尔莫哥洛夫-阿诺德网络(KANs)已在多个领域取得成功,其中物理信息机器学习(PIML)是其表现突出的领域。基于切比雪夫多项式的物理信息KAN(cPIKAN)因计算高效成为主流,但与多层感知机类似,其在深度扩展时面临严重训练不稳定性,限制了对若干偏微分方程(PDE)问题的应用。为此,我们提出一种无基底依赖、类Glorot的初始化方案,可维持激活值方差,显著提升稳定性与精度。受PirateNet架构启发,进一步引入残差门控自适应KAN(RGA KAN),以解决仅靠初始化无法缓解的深层cPIKAN发散问题。通过实证测试与信息瓶颈分析,RGA KAN能完整经历所有训练阶段,而基准cPIKAN在特定PDE设置下停滞于扩散阶段。在固定训练流程和自适应组件下,对九个标准前向PDE基准的评估显示,RGA KAN始终优于参数匹配的cPIKAN与PirateNets,性能提升可达数个数量级,且在其他模型发散的场景中仍保持稳定。

原文摘要 · Abstract (English)

Since their introduction, Kolmogorov-Arnold Networks (KANs) have been successfully applied across several domains, with physics-informed machine learning (PIML) emerging as one of the areas where they have thrived. In the PIML setting, Chebyshev-based physics-informed KANs (cPIKANs) have become the standard due to their computational efficiency. However, like their multilayer perceptron-based counterparts, cPIKANs face significant challenges when scaled to depth, leading to training instabilities that limit their applicability to several PDE problems. To address this, we propose a basis-agnostic, Glorot-like initialization scheme that preserves activation variance and yields substantial improvements in stability and accuracy over the default initialization of cPIKANs. Inspired by the PirateNet architecture, we further introduce Residual-Gated Adaptive KANs (RGA KANs), designed to mitigate divergence in deep cPIKANs where initialization alone is not sufficient. Through empirical tests and information bottleneck analysis, we show that RGA KANs successfully traverse all training phases, unlike baseline cPIKANs, which stagnate in the diffusion phase in specific PDE settings. Evaluations on nine standard forward PDE benchmarks under a fixed training pipeline with adaptive components demonstrate that RGA KANs consistently outperform parameter-matched cPIKANs and PirateNets - often by several orders of magnitude - while remaining stable in settings where the others diverge.

深度学习偏微分方程神经网络物理信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。