分频训练多时标动力系统,提升长期预测能力
Frequency-Separable Hamiltonian Neural Network for Multi-Timescale Dynamics
- 用多个网络分别学习快慢动态,按不同采样频率训练
- 在复杂系统上实现更长时程的外推性能提升
- 适合需要跨时间尺度建模的动力学与偏微分方程问题
尽管哈密顿力学为建模动力系统提供了强大的归纳偏置,但哈密顿神经网络及其变体往往难以捕捉跨越多个时间尺度的复杂动态。这一局限常归因于深度神经网络的谱偏差,即倾向于学习低频、缓慢变化的动态。先前方法通过辛积分方案保证能量守恒或引入几何约束来施加配置空间结构,但这些方法要么无法充分捕捉多尺度动态,要么需大量领域特定假设。本文观察到哈密顿函数可显式分解为快慢模式,并能从这些分量重构。为此提出频率分离的哈密顿神经网络(FS-HNN),通过多个网络分别参数化系统哈密顿量,每个网络基于各自时间尺度的数据进行训练。进一步将该框架扩展至偏微分方程,学习状态与边界条件相关的辛算子。实验表明,FS-HNN在挑战性动力系统中显著提升长期外推性能,并在广泛的常微分方程与偏微分方程问题上展现良好泛化能力。
原文摘要 · Abstract (English)
While Hamiltonian mechanics provides a powerful inductive bias for neural networks modeling dynamical systems, Hamiltonian Neural Networks and their variants often fail to capture complex temporal dynamics spanning multiple timescales. This limitation is commonly linked to the spectral bias of deep neural networks, which favors learning low-frequency, slow-varying dynamics. Prior approaches have sought to address this issue through symplectic integration schemes that enforce energy conservation or by incorporating geometric constraints to impose structure on the configuration-space. However, such methods either remain limited in their ability to fully capture multiscale dynamics or require substantial domain specific assumptions. In this work, we exploit the observation that Hamiltonian functions admit decompositions into explicit fast and slow modes and can be reconstructed from these components. We introduce the Frequency-Separable Hamiltonian Neural Network (FS-HNN), which parameterizes the system Hamiltonian using multiple networks, each governed by Hamiltonian dynamics and trained on data sampled at distinct timescales. We further extend this framework to partial differential equations by learning a state- and boundary-conditioned symplectic operators. Empirically, we show that FS-HNN improves long-horizon extrapolation performance on challenging dynamical systems and generalizes across a broad range of ODE and PDE problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。