arXiv:2603.09742cs.LGmath.DS2026-03

为神经振子模型提供了可证明的泛化误差上界,解释了其在动态系统建模中的稳健性。

Upper Generalization Bounds for Neural Oscillators

  • 基于Rademacher复杂度推导神经振子的泛化上界
  • 误差随MLP规模和时间长度多项式增长,避免参数灾难
  • 正则化MLP的Lipschitz常数可提升小样本下的性能

源自二阶常微分方程(ODE)的神经振子在学习复杂非线性结构系统动态载荷与响应映射方面展现出良好性能。尽管有经验成功,其神经网络架构的泛化能力尚缺乏理论刻画。本文研究由二阶ODE后接多层感知机(MLP)构成的神经振子,利用Rademacher复杂度框架,推导出其在连续时间函数空间间近似因果且一致连续算子,以及近似均匀渐近增量稳定二阶动力系统的上界。进一步将这些上界扩展至目标因果算子与学习到的神经振子所生成量值概率测度间的平方Wasserstein-1距离。理论结果表明,估计误差关于MLP大小和时间长度呈多项式增长,避免了参数复杂度的诅咒。此外,通过损失函数正则化约束MLP的Lipschitz常数,可提升神经振子的泛化能力。数值实验基于随机地震激励下的Bouc-Wen非线性系统,验证了估计误差随样本量和时间长度的幂律变化规律,并证实限制MLP矩阵与向量范数在有限训练数据下能有效提升模型性能。

原文摘要 · Abstract (English)

Neural oscillators that originate from second-order ordinary differential equations (ODEs) have shown competitive performance in learning mappings between dynamic loads and responses of complex nonlinear structural systems. Despite this empirical success, theoretically quantifying the generalization capacities of their neural network architectures remains undeveloped. In this study, the neural oscillator consisting of a second-order ODE followed by a multilayer perceptron (MLP) is considered. Its upper probably approximately correct (PAC) generalization bound for approximating causal and uniformly continuous operators between continuous temporal function spaces and that for approximating the uniformly asymptotically incrementally stable second-order dynamical systems are derived by leveraging the Rademacher complexity framework. These bounds are further extended to the squared Wasserstein-1 distances between the probability measures of quantities of interest calculated from target causal operators and the corresponding learned neural oscillators. The theoretical results show that the estimation errors grow polynomially with respect to both MLP sizes and the time length, thereby avoiding the curse of parametric complexity. Furthermore, the derived error bounds demonstrate that constraining the Lipschitz constants of the MLPs via loss function regularization can improve the generalization ability of the neural oscillator. Numerical studies considering a Bouc-Wen nonlinear system under stochastic seismic excitation validates the theoretically predicted power laws of the estimation errors with respect to the sample size and time length, and confirms the effectiveness of constraining MLPs' matrix and vector norms in enhancing the performance of the neural oscillator under limited training data.

神经振子泛化边界动力系统机器学习理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。