arXiv:2603.01193cs.LG2026-03被引 2

用随机采样弱监督训练神经算子,高效求解一类偏微分方程。

Operator Learning Using Weak Supervision from Walk-on-Spheres

  • 基于球面行走法生成噪声解作为弱标签,避免高阶导数计算
  • 相同训练步数下误差降低8.75倍,速度提升6.31倍,显存减少2.97倍
  • 无需预训练数据集,可零样本推广到新参数与新区域

训练神经偏微分方程求解器常受限于昂贵的数据生成或不稳定的物理信息神经网络(PINN),后者因高阶导数导致优化困难。为此,我们提出一种新方法:利用蒙特卡洛估计将偏微分方程解建模为随机过程,实现训练中的弱监督。基于球面行走法(Walk-on-Spheres, WoS),我们构建了"球面行走神经算子"(WoS-NO),通过在多个偏微分方程实例上共享随机路径表示,以低成本生成噪声解作为监督信号。该方法形成无需数据的物理信息目标函数,使神经算子学习整个家族偏微分方程的通用解映射。本策略无需预计算数据集,避免内存密集且不稳定的高阶导数计算,实现了对新参数和新域的零样本泛化。实验表明,在相同训练步数下,本方法相比标准物理信息训练方案,L₂误差降低最高达8.75倍,训练速度提升最高6.31倍,GPU内存消耗减少最高2.97倍。代码已开源:https://github.com/neuraloperator/WoS-NO

原文摘要 · Abstract (English)

Training neural PDE solvers is often bottlenecked by expensive data generation or unstable physics-informed neural network (PINN) involving challenging optimization landscapes due to higher-order derivatives. To tackle this issue, we propose an alternative approach using Monte Carlo approaches to estimate the solution to the PDE as a stochastic process for weak supervision during training. Leveraging the Walk-on-Spheres method, we introduce a learning scheme called \emph{Walk-on-Spheres Neural Operator (WoS-NO)} which uses weak supervision from WoS to train any given neural operator. We propose to amortize the cost of Monte Carlo walks across the distribution of PDE instances using stochastic representations from the WoS algorithm to generate cheap, noisy, estimates of the PDE solution during training. This is formulated into a data-free physics-informed objective where a neural operator is trained to regress against these weak supervisions, allowing the operator to learn a generalized solution map for an entire family of PDEs. This strategy does not require expensive pre-computed datasets, avoids computing higher-order derivatives for loss functions that are memory-intensive and unstable, and demonstrates zero-shot generalization to novel PDE parameters and domains. Experiments show that for the same number of training steps, our method exhibits up to 8.75$\times$ improvement in $L_2$-error compared to standard physics-informed training schemes, up to 6.31$\times$ improvement in training speed, and reductions of up to 2.97$\times$ in GPU memory consumption. We present the code at https://github.com/neuraloperator/WoS-NO

神经算子偏微分方程弱监督随机方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。