用微分方程定义网络层,让神经网络更像真实物理系统。
Physics-Modeled Neural Networks

- 每层由常微分方程描述,用动态系统替代静态激活函数。
- 参数更少却性能媲美神经ODE和连续网络,在加州房价数据集上表现良好。
- 结合神经科学模型,适合关注可解释性与物理建模的研究者。
我们提出 extit{动力学物理建模神经网络}(DynPMNNs),一种以常微分方程解定义隐藏层的连续时间深度学习架构。与传统前馈网络不同,该方法将静态激活函数替换为随时间演化的动力系统,提供生物启发的隐层行为解释,并支持物理意义明确的模型集成。框架在再生核巴拿赫空间(RKBS)严格奠基下,使DynPMNNs可表征为抽象训练问题的有限维解,揭示其与标准神经网络的结构关联。我们基于FitzHugh--Nagumo神经元模型实现具体架构,通过欧拉型数值求解器嵌入计算图,联合训练网络权重与动力学参数。在加州房价数据集上的实验表明,尽管参数更少,DynPMNNs仍达到与神经微分方程(NODEs)和闭式连续时间网络(CfCs)相当的性能。结果表明DynPMNNs是动力系统与深度学习间的原理性桥梁,未来在表达能力、稳定性与物理建模方面具有广阔研究前景。
原文摘要 · Abstract (English)
We introduce \emph{Dynamical Physics-Modeled Neural Networks} (DynPMNNs), a continuous-time deep learning architecture in which each hidden layer is defined as the solution of an ordinary differential equation. Unlike classical feed-forward networks, this approach replaces static activation functions with time-evolving dynamical systems, providing a biologically inspired interpretation of hidden-layer behavior and enabling the integration of physically meaningful models. The framework is rigorously grounded in Reproducing Kernel Banach Spaces (RKBSs), allowing DynPMNNs to be characterized as finite-dimensional solutions of an abstract training problem and revealing structural connections with standard neural networks. We present a concrete implementation based on the FitzHugh--Nagumo model for neuronal activation, where numerical ODE solvers are embedded into the computational graph via Euler-type schemes. Both network weights and dynamical parameters are trained jointly. Through experiments on the California Housing dataset, we compare DynPMNNs with Neural ODEs (NODEs) and Closed-form Continuous-Time Networks (CfCs). Despite using fewer trainable parameters, DynPMNNs achieve competitive performance. These results position DynPMNNs as a principled bridge between dynamical systems and deep learning, with promising directions for further research in expressivity, stability, and physics-based modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。