arXiv:2410.00053cs.LG2024-10被引 26

自适应调整参数的多尺度神经网络,显著提升高频函数逼近精度。

Frequency-adaptive Multi-scale Deep Neural Networks

  • 根据频率信息动态调整映射参数,增强模型适应性。
  • 在波传播与薛定谔方程中,精度提升两到三个数量级。
  • 适合需要高精度逼近高频物理现象的研究者使用。

具有下采样映射的多尺度深度神经网络(MscaleDNN)在逼近具有高频特征的目标函数方面优于传统DNN。然而,其性能高度依赖于下采样映射中的参数,限制了广泛应用。本文建立了拟合误差上界,解释了MscaleDNN在高频函数逼近上的优势。基于此,提出混合特征嵌入以增强下采样映射的准确性和鲁棒性。为降低对参数的依赖,提出频率自适应MscaleDNN,根据后验误差估计动态调整参数,捕捉拟合函数的频率信息。数值实验包括波传播及光滑势下薛定谔方程在半经典极限附近的局域解传播,结果表明,该方法相比标准MscaleDNN精度提升两到三个数量级。

原文摘要 · Abstract (English)

Multi-scale deep neural networks (MscaleDNNs) with downing-scaling mapping have demonstrated superiority over traditional DNNs in approximating target functions characterized by high frequency features. However, the performance of MscaleDNNs heavily depends on the parameters in the downing-scaling mapping, which limits their broader application. In this work, we establish a fitting error bound to explain why MscaleDNNs are advantageous for approximating high frequency functions. Building on this insight, we construct a hybrid feature embedding to enhance the accuracy and robustness of the downing-scaling mapping. To reduce the dependency of MscaleDNNs on parameters in the downing-scaling mapping, we propose frequency-adaptive MscaleDNNs, which adaptively adjust these parameters based on a posterior error estimate that captures the frequency information of the fitted functions. Numerical examples, including wave propagation and the propagation of a localized solution of the schr$\ddot{\text{o}}$dinger equation with a smooth potential near the semi-classical limit, are presented. These examples demonstrate that the frequency-adaptive MscaleDNNs improve accuracy by two to three orders of magnitude compared to standard MscaleDNNs.

多尺度神经网络高频逼近自适应优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。