用神经网络求解基尔霍夫相位方程,验证了网络结构对精度和速度的影响。
A Neural Network for the Identical Kuramoto Equation: Architectural Considerations and Performance Evaluation
- 对比tanh、sin、ReLU激活函数及深度宽度配置,优化网络结构
- 最优网络在能量范数下误差与传统方法相当,计算效率更优
- 发现标准网络会过度平滑尖锐特征,限制其在不连续系统中的应用
本文研究深度神经网络(DNN)逼近由相同振子柯尔莫哥洛夫-库拉莫特模型导出的非局部守恒律解的效率,重点评估网络架构选择对解精度(能量范数)和计算时间的影响。通过系统实验发现,激活函数(tanh vs. sin vs. ReLU)、网络深度(4-8层)、宽度(64-256个神经元)及训练方法(采样点数量、迭代轮数)显著影响收敛性。tanh激活在各配置下均表现稳定,而sin激活在个别情况下可获得更低误差与更短训练时间,但偶发产生非物理解。与传统数值方法对比显示,优化后的DNN具备竞争性精度,且计算开销不同。此外,我们发现标准前馈网络在处理奇异或分段常数解时存在根本局限,实证表明其因激活函数自然函数空间限制,会天然地过度平滑尖锐特征。本工作为基于神经网络的科学计算提供实践指导,并揭示需突破的理论瓶颈,以拓展其在含不连续物理系统的应用。
原文摘要 · Abstract (English)
In this paper, we investigate the efficiency of Deep Neural Networks (DNNs) to approximate the solution of a nonlocal conservation law derived from the identical-oscillator Kuramoto model, focusing on the evaluation of an architectural choice and its impact on solution accuracy based on the energy norm and computation time. Through systematic experimentation, we demonstrate that network configuration parameters-specifically, activation function selection (tanh vs. sin vs. ReLU), network depth (4-8 hidden layers), width (64-256 neurons), and training methodology (collocation points, epoch count)-significantly influence convergence characteristics. We observe that tanh activation yields stable convergence across configurations, whereas sine activation can attain marginally lower errors and training times in isolated cases, but occasionally produce nonphysical artefacts. Our comparative analysis with traditional numerical methods shows that optimally configured DNNs offer competitive accuracy with notably different computational trade-offs. Furthermore, we identify fundamental limitations of standard feed-forward architectures when handling singular or piecewise-constant solutions, providing empirical evidence that such networks inherently oversmooth sharp features due to the natural function space limitations of standard activation functions. This work contributes to the growing body of research on neural network-based scientific computing by providing practitioners with empirical guidelines for DNN implementation while illuminating fundamental theoretical constraints that must be overcome to expand their applicability to more challenging physical systems with discontinuities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。