arXiv:2608.16084cs.AIcs.LG2026-08

揭示神经模型在混沌系统中误差增长的根源,提出稳定性诊断新方法。

Eigenanalysis framework for autoregressive neural emulators of multi-scale chaotic dynamics

论文配图:Eigenanalysis framework for autoregressive neural emulators of multi-scale chaotic dynamics
图 1 · 摘自论文原文
  • 通过分析模型更新映射的雅可比矩阵,发现误差增长由其谱半径决定。
  • 直接步模型普遍存在大于1的不稳定特征值,而积分约束模型实现中性稳定。
  • 提供无需滚动计算的先验稳定性诊断,适合改进混沌系统模拟器设计。

神经自回归模型已成为高维混沌系统的强大模拟器,但其长期不稳定性和误差增长机制仍不明确,导致依赖经验方案。本文构建了一种特征值分析框架,揭示误差增长的动态起源。通过分析学习到的一步更新映射关于状态的雅可比矩阵,发现推断时的误差增长由其谱半径决定。直接步架构(从上一状态预测下一状态)普遍具有超过1的不稳定特征值,解释了这些广泛使用模型的快速发散。相反,积分约束模型(估计时间导数并用高阶积分器积分)将特征谱压缩至单位圆上,实现中性稳定和普适的线性误差增长规律。该雅可比矩阵的最大特征值可作为与架构无关的先验诊断指标,无需昂贵滚动即可评估短期性能、长期稳定性和谱偏差。基于此理论,我们引入一种促进稳定性的损失函数,显式正则化雅可比驱动的误差放大,提升预测精度与动力学鲁棒性。在29个模型上验证,涵盖两种架构、多个显式与隐式积分器及不同损失函数,均以柯马托-希瓦辛斯基系统为基准。本研究为多尺度混沌动力学神经模拟器的设计与评估提供了理论基础。更广泛而言,该框架填补了科学机器学习在先验稳定性分析方面的空白,类似于数值分析对微分方程离散化所提供的分析能力。

原文摘要 · Abstract (English)

Neural autoregressive models have rapidly emerged as powerful emulators of high-dimensional chaotic systems, yet their long-term instability and error growth remain poorly understood, leading to ad-hoc solutions. Here, we develop an eigenanalysis framework that reveals the dynamical origin of this error growth. By analyzing the Jacobian of the learned one-step update map with respect to the state, we show how inference-time error growth, and thus model stability, is governed by its spectral radius. Direct-step architectures (models that predict the next state from the previous one) generically admit unstable eigenvalues with magnitudes exceeding one, explaining the rapid divergence of these widely used models. In contrast, integration-constrained models (where the time derivative is estimated and integrated with a higher-order integrator) collapse their eigenspectrum onto the unit circle, yielding neutral stability and a universal linear error-scaling law. The largest eigenvalue of this Jacobian provides an architecture-agnostic, a priori diagnostic of short-term skill, long-term stability, and spectral bias, without requiring an expensive rollout. Leveraging this theory, we introduce a stability-promoting loss that explicitly regularizes Jacobian-driven error amplification, improving both forecast accuracy and dynamical robustness. Demonstrated across $29$ models spanning two architectures, several explicit and implicit integrators, and multiple loss functions on the Kuramoto-Sivashinsky system, our results establish a theoretical foundation for the design and evaluation of neural emulators of chaotic multi-scale dynamics. More broadly, our framework is a step toward the kind of a priori stability analysis that numerical analysis provides for discretizations of differential equations and that scientific machine learning currently lacks.

混沌系统神经模拟器稳定性分析雅可比矩阵

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。