arXiv:2509.18131cs.LGcs.AI2025-09被引 1

揭示物理神经网络中随机权重如何影响信号传播稳定性

Randomness and signal propagation in physics-informed neural networks (PINNs): A neural PDE perspective

  • 用神经偏微分方程视角分析权重结构与信号演化关系
  • 发现训练后权重处于高熵状态,符合随机矩阵理论预测
  • 稳定数值格式可保障信号良好传播,适合研究模型稳定性

物理信息神经网络(PINNs)在训练后常表现出统计上随机的权值矩阵,但其对信号传播和稳定性的影响仍不明确。本文以一维黏性和无黏性伯格斯方程为实验基准,分析训练后权重的谱与统计特性,发现其处于符合随机矩阵理论预测的高熵态。进一步通过神经偏微分方程(neural PDEs)视角,研究信号在深层网络中的演化机制,表明随机与结构化权重对应不同离散化方案,其数值稳定性直接决定信号传播的稳定性。显式不稳定格式导致信号退化,而隐式或高阶稳定格式则实现良好动力学行为。结果揭示了数值稳定性与网络架构如何共同塑造深度网络中的信号传播,为理解PINNs提供随机矩阵与神经PDE双重视角。

原文摘要 · Abstract (English)

Physics-informed neural networks (PINNs) often exhibit weight matrices that appear statistically random after training, yet their implications for signal propagation and stability remain unsatisfactorily understood, let alone the interpretability. In this work, we analyze the spectral and statistical properties of trained PINN weights using viscous and inviscid variants of the one-dimensional Burgers' equation, and show that the learned weights reside in a high-entropy regime consistent with predictions from random matrix theory. To investigate the dynamical consequences of such weight structures, we study the evolution of signal features inside a network through the lens of neural partial differential equations (neural PDEs). We show that random and structured weight matrices can be associated with specific discretizations of neural PDEs, and that the numerical stability of these discretizations governs the stability of signal propagation through the network. In particular, explicit unstable schemes lead to degraded signal evolution, whereas stable implicit and higher-order schemes yield well-behaved dynamics for the same underlying neural PDE. Our results offer an explicit example of how numerical stability and network architecture shape signal propagation in deep networks, in relation to random matrix and neural PDE descriptions in PINNs.

PINN神经PDE随机矩阵信号传播

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。