arXiv:2505.08687cs.LGcs.AI2025-05被引 2

改进物理信息神经网络,提升微分方程求解精度与稳定性。

AC-PKAN: Attention-Enhanced and Chebyshev Polynomial-Based Physics-Informed Kolmogorov-Arnold Networks

  • 用切比雪夫多项式+注意力机制增强网络表达能力。
  • 在9个基准任务中优于或媲美顶尖模型,零数据下表现突出。
  • 适合求解少样本或无数据条件下的复杂工程微分方程问题。

Kolmogorov-Arnold网络(KANs)在求解偏微分方程(PDEs)方面展现出潜力,但其原始结构存在计算与内存开销大问题。为此提出基于切比雪夫Ⅰ型的KAN(Chebyshev1KAN),虽性能优于原始KAN,但理论分析显示仍存在秩坍缩问题,限制表达能力。本文通过引入可学习的波浪激活MLP和内部注意力机制,证明该设计能保持满秩雅可比矩阵,并可逼近任意阶PDE解。为缓解切比雪夫基导致的损失不稳与不平衡,外置残差梯度注意力(RGA)机制,动态根据梯度范数与残差大小重加权各损失项。结合内外注意力,提出AC-PKAN,作为弱监督物理信息神经网络(PINNs)的增强架构,扩展了KAN的表达能力。九个跨三个领域的基准测试表明,AC-PKAN始终优于或匹配现有先进模型如PINNsFormer,是解决真实世界工程问题中零数据或数据稀疏场景的有效工具。代码将在录用后公开。

原文摘要 · Abstract (English)

Kolmogorov-Arnold Networks (KANs) have recently shown promise for solving partial differential equations (PDEs). Yet their original formulation is computationally and memory intensive, motivating the introduction of Chebyshev Type-I-based KANs (Chebyshev1KANs). Although Chebyshev1KANs have outperformed the vanilla KANs architecture, our rigorous theoretical analysis reveals that they still suffer from rank collapse, ultimately limiting their expressive capacity. To overcome these limitations, we enhance Chebyshev1KANs by integrating wavelet-activated MLPs with learnable parameters and an internal attention mechanism. We prove that this design preserves a full-rank Jacobian and is capable of approximating solutions to PDEs of arbitrary order. Furthermore, to alleviate the loss instability and imbalance introduced by the Chebyshev polynomial basis, we externally incorporate a Residual Gradient Attention (RGA) mechanism that dynamically re-weights individual loss terms according to their gradient norms and residual magnitudes. By jointly leveraging internal and external attention, we present AC-PKAN, a novel architecture that constitutes an enhancement to weakly supervised Physics-Informed Neural Networks (PINNs) and extends the expressive power of KANs. Experimental results from nine benchmark tasks across three domains show that AC-PKAN consistently outperforms or matches state-of-the-art models such as PINNsFormer, establishing it as a highly effective tool for solving complex real-world engineering problems in zero-data or data-sparse regimes. The code will be made publicly available upon acceptance.

物理信息微分方程神经网络少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。