arXiv:2509.16395stat.MLcs.LG2025-09被引 1

通过自适应切空间降维,大幅降低演化神经网络的计算开销。

Low-Rank Evolutionary Deep Neural Networks via Adaptive Tangent-Space Reduction

  • 用切空间投影替代全量参数更新,构建低秩演化模型。
  • 在1~2维问题上保持与全模型相当的精度,计算耗时降低超70%。
  • 适合需要长时间序列模拟的物理方程求解场景。

演化深度神经网络(EDNN)通过局部最小二乘问题逐时步演化网络参数以求解时变偏微分方程,但每步需求解维度等于可训练参数总数的稠密线性系统,计算开销巨大。本文提出低秩演化神经网络(LR-EDNN),通过自适应切空间投影降低计算成本。该方法不显式构造完整雅可比矩阵,而是通过逐层雅可比-向量乘积直接构建降维后的雅可比,将双线性低秩演化替换为线性降维问题,同时保持原方法的时间顺序结构。理论分析给出有限时间比较估计:LR-EDNN轨迹与全模型的偏差受局部切空间投影误差的离散格罗瓦尔德累积控制,放大系数由假设的利普希茨常数和方向强制性常数决定。数值实验在含漂移的多孔介质方程、一维与二维阿拉因-卡恩方程及二维粘性伯吉斯方程上验证,当秩选择适当时,LR-EDNN显著降低计算成本,同时保持全模型的精度与定性保真度。

原文摘要 · Abstract (English)

Evolutionary deep neural networks (EDNNs) solve time-dependent partial differential equations by evolving the neural-network parameters sequentially in time through a local least-squares problem. Their main computational bottleneck is that each time step requires the solution of a dense linear system whose dimension equals the total number of trainable parameters. We propose a low-rank evolutionary deep neural network (LR-EDNN) method that reduces this cost through adaptive tangent-space projection. This construction replaces direct bilinear low-rank factor evolution by a linear reduced problem while preserving the sequential-in-time structure of EDNN. We construct the reduced Jacobian directly through layerwise Jacobian-vector products, without forming the full Jacobian. We further establish a finite-time comparison estimate: the deviation of the LR-EDNN trajectory from full EDNN is bounded by a discrete Grönwall accumulation of the local tangent-space projection defects, with amplification governed by the assumed Lipschitz and directional-coercivity constants. Numerical experiments on a porous-medium equation with drift, one- and two-dimensional Allen-Cahn equations, and two-dimensional viscous Burgers' equations demonstrate that LR-EDNN substantially reduces computational cost while maintaining the accuracy and qualitative fidelity of the full EDNN solver when the rank is chosen adequately.

神经网络偏微分方程降维计算效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。