让神经网络解偏微分方程更稳定,自动优化关键参数分布。
Adaptive-Distribution Randomized Neural Networks for PDEs: A Low-Dimensional Distribution-Learning Framework

- 用低维参数动态调整隐藏层特征分布,替代手动设定。
- 在多个基准问题上实现高精度,减少对人工设计分布的依赖。
- 适合需要稳定高效求解PDE的科研与工程人员使用。
随机神经网络(RaNNs)因其将昂贵的端到端训练替换为线性最小二乘求解而适用于偏微分方程(PDEs),但其性能高度依赖隐藏层参数的采样分布,该分布通常需手工设定且问题特异。本文提出自适应分布随机神经网络(AD-RaNN),将固定启发式分布的选择转化为低维参数化的可优化问题。AD-RaNN仅优化一个低维向量p来控制隐藏特征采样分布,保持了RaNN的最小二乘结构,同时减少了人工调参。方法采用两阶段策略:先用岭正则化进行稳定优化,再通过无正则化最小二乘恢复最终解。提出两种自适应机制:基于PDE的PDAD与基于数据的DDAD,应用于时空求解器、离散时间求解器及算子学习模型,并引入自适应层数增长以捕捉局部结构。理论分析证明了简化目标函数的良好适定性、岭正则化最小化器的一致性、高效梯度公式及岭参数的实用下界。数值实验表明,AD-RaNN实现了有效的分布级自适应,显著降低对手工设计分布的依赖,具备强鲁棒性和高精度。
原文摘要 · Abstract (English)
Randomized neural networks (RaNNs) are attractive for partial differential equations (PDEs) because they replace expensive end-to-end training with a linear least-squares solve over randomized hidden features. Their practical performance, however, depends strongly on the sampling distribution of the hidden-layer parameters, which is usually chosen heuristically and problem by problem. This distribution sensitivity is a central bottleneck in randomized neural PDE solvers. In this work, we propose Adaptive-Distribution Randomized Neural Networks (AD-RaNN), a framework that promotes randomized feature generation from a fixed heuristic choice to a low-dimensional adaptive optimization problem. Instead of training all hidden weights and biases, AD-RaNN parameterizes the hidden-feature sampling distribution by a low-dimensional vector p and optimizes only p, thereby preserving the least-squares structure of RaNNs while reducing manual distribution tuning. The method uses a two-stage strategy: ridge-regularized reduced training for stable distribution-parameter optimization, followed by an unregularized least-squares refit for final solution recovery. We develop two adaptive mechanisms, PDE-Driven Adaptive Distribution (PDAD) and Data-Driven Adaptive Distribution (DDAD), and deploy them in space-time solvers, discrete-time solvers, and operator-learning models. We also incorporate an adaptive layer-growth enhancement for localized structures. For the reduced optimization problem, we establish well-posedness of the reduced objectives, consistency of ridge-regularized minimizers, an efficient gradient formula, and a practical lower-bound estimate for the ridge parameter. Numerical experiments on benchmark problems show that AD-RaNN provides an effective distribution-level adaptation mechanism, reduces reliance on hand-crafted hidden-feature distributions, and achieves strong empirical accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。