用混合神经网络逼近复杂系统中的不变流形,提升精度与可解释性。
Invariant Manifolds of Discrete-time Dynamical Systems with Nonlinear Exosystems via Hybrid Physics-Informed Neural Networks
- 结合多项式与浅层神经网络,分区域建模系统状态关系
- 在酶反应生物反应器和车流跟随模型中,精度优于纯神经网络或纯多项式方法
- 适合研究多智能体系统、控制理论等领域的低中维动态系统
本文提出一种混合物理信息机器学习框架,用于近似由外生自主动力系统驱动的离散时间动力系统的不变流形(IM)。此类系统广泛存在于控制理论及分层领导下的多智能体行为建模(如鸟群、交通流)中。将不变流形学习问题转化为求解非线性函数方程,通过外生状态与系统状态之间的关系表达流形。方法结合多项式级数与浅层神经网络,利用其互补优势:靠近平衡点时多项式具可解释性与收敛性,远离时神经网络借助通用逼近能力捕捉全局结构。在接口处引入连续性惩罚项以保证两部分一致性,训练采用勒让德-马尔夸特算法,并基于解析导数进行优化。根据系统维度,亦可采用纯神经网络方案,本文在特定系统动态假设下建立了其通用逼近定理。在酶促生物反应器与领导者-跟随者车流模型两个基准问题上评估了收敛性、逼近精度与计算成本,对比独立神经网络、多项式展开与混合方法。结果表明,混合方法在精度上显著优于单一方案。
原文摘要 · Abstract (English)
We propose a hybrid physics-informed machine learning framework to approximate invariant manifolds (IMs) of discrete-time dynamical systems driven by exogenous autonomous dynamics (exosystems). Such systems appear in applications ranging from control theory to modeling collective multi-agent behavior (e.g., bird flocks, traffic dynamics) under hierarchical leadership. The IM learning problem is formulated as solving nonlinear functional equations derived from the invariance equation, expressing the manifold as a relationship between exogenous and system states. The proposed approach combines polynomial series with shallow neural networks, leveraging their complementary strengths. We focus on low- to medium-dimensional manifolds where polynomial expansions remain tractable. Near equilibrium, polynomial series provide interpretability and convergence, while farther away neural networks capture global structure through their universal approximation capability. A continuity penalty enforces consistency between both representations at their interface, and training is performed using analytically derived derivatives within the Levenberg-Marquardt scheme. Naturally, depending on the dimensionality of the input-driven system, one may also employ a purely neural network-based IM approximation, for which we also establish a universal approximation theorem based on certain assumptions on system dynamics. The framework is evaluated on two benchmark problems: an enzymatic bioreactor and a leader-follower car-following model. We analyze convergence, approximation accuracy, and computational cost, and compare standalone neural networks, polynomial expansions, and the hybrid method. Results show that the hybrid approach achieves superior accuracy compared to standalone schemes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。