arXiv:2412.05719math.NAcs.LG2024-12被引 8

用可解释的自适应网格神经网络求解偏微分方程,精度高且训练快。

Finite Element Neural Network Interpolation. Part I: Interpretable and Adaptive Discretization for Solving PDEs

  • 基于参考单元定义形状函数,支持灵活插值与高效积分。
  • 多网格训练策略使训练效率和鲁棒性显著提升。
  • 适合需要高精度与物理可解释性的科学计算场景。

我们提出有限元神经网络插值(FENNI)框架,是嵌入式有限元神经网络(EFENN)的扩展,延续了分层深度学习神经网络(HiDeNN)的工作。由于基于网格结构,EFENN所需可训练参数远少于全连接网络,且权重和偏置具有明确物理意义。FENNI在该框架下实现三项改进:第一,采用参考单元架构,形状函数在参考单元上定义,支持插值函数多样化,并可直接使用高斯积分计算损失;第二,提出一种基于可解释性的实用多网格训练策略;第三,将HiDeNN的混合rh自适应从1D推广至2D,引入基于雅可比的节点添加准则,统一处理h-和r-自适应。从深度学习角度看,通过rh自适应和多网格策略实现的自适应网格行为相当于迁移学习,使FENNI可在训练中动态优化网络结构。在1D与2D测试案例中,其精度与计算成本与解析解及经典有限元法对比,表现优异。多网格策略大幅提升了训练阶段的效率与稳定性。最后,在EFENN框架内引入变分损失,其性能优于残差型损失,与能量型损失相当。该框架在第二部分将扩展至参数空间的代理建模。

原文摘要 · Abstract (English)

We present the Finite Element Neural Network Interpolation (FENNI) framework, a sparse neural network architecture extending previous work on Embedded Finite Element Neural Networks (EFENN) introduced with the Hierarchical Deep-learning Neural Networks (HiDeNN). Due to their mesh-based structure, EFENN requires significantly fewer trainable parameters than fully connected neural networks, with individual weights and biases having a clear interpretation. Our FENNI framework, within the EFENN framework, brings improvements to the HiDeNN approach. First, we propose a reference element-based architecture where shape functions are defined on a reference element, enabling variability in interpolation functions and straightforward use of Gaussian quadrature rules for evaluating the loss function. Second, we propose a pragmatic multigrid training strategy based on the framework's interpretability. Third, HiDeNN's combined rh-adaptivity is extended from 1D to 2D, with a new Jacobian-based criterion for adding nodes combining h- and r-adaptivity. From a deep learning perspective, adaptive mesh behavior through rh-adaptivity and the multigrid approach correspond to transfer learning, enabling FENNI to optimize the network's architecture dynamically during training. The framework's capabilities are demonstrated on 1D and 2D test cases, where its accuracy and computational cost are compared against an analytical solution and a classical FEM solver. On these cases, the multigrid training strategy drastically improves the training stage's efficiency and robustness. Finally, we introduce a variational loss within the EFENN framework, showing that it performs as well as energy-based losses and outperforms residual-based losses. This framework is extended to surrogate modeling over the parametric space in Part II.

神经网络偏微分方程有限元自适应网格

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。