用约束神经网络从稀疏观测中自动发现积分微分方程的非局部核,提升模型可解释性与鲁棒性。
Neural Discovery of Memory and Nonlocal Kernels in Integro-Differential Equations with Constrained Kolmogorov--Arnold Networks

- 用受限柯尔莫哥洛夫-阿诺德网络(KAN)参数化未知核函数,物理约束通过硬约束或软惩罚实现。
- 在1D问题上准确恢复核形式,2D稀疏噪声数据下硬约束方法误差更低,表现更稳定。
- 适合需要可解释物理核的科学建模场景,如材料力学、反应扩散系统等复杂系统逆问题。
从稀疏且含噪的时空观测中发现积分微分方程(IDE)的内存或非局部核,是一个病态反问题。现有方法常依赖特定解析推导、特殊观测条件或对核的强假设,限制了其在不同类IDE中的通用性。本文提出一种基于可微求解器的框架,直接从时空观测中发现核函数。在求解器中,未知核由受限柯尔莫哥洛夫-阿诺德网络(KAN)表示,物理约束通过两种方式实现:基于伯恩斯坦多项式的单调-凸KAN(MC-KAN),通过系数约束构造保证正性、单调递减和凸性;基于切比雪夫的KAN(Cheb-KAN),则通过软惩罚项鼓励相同性质。训练后,采用符号回归提取可解释的闭式表达。在三个基准测试上评估:一维伏特拉方程、一维粘弹性波偏积分微分方程、二维各向异性耦合核的非局部反应-扩散方程。1D问题中,两种方法均恢复正确核形式,重建精度相当;而2D稀疏噪声问题中,硬约束的MC-KAN始终优于软约束的Cheb-KAN,核重构误差更低。结果表明,通过构造方式强制物理形状约束,比软惩罚在多维核发现中更具鲁棒性。
原文摘要 · Abstract (English)
Discovering the memory or nonlocal kernel governing an integro-differential equation (IDE) from sparse and noisy observations is an ill-posed inverse problem. Existing identification methods often rely on problem-specific analytical derivations, specialized observation requirements, or restrictive assumptions about the kernel, limiting their applicability across different classes of IDEs. In this work, we propose a differentiable-solver-based framework for discovering memory and nonlocal kernels directly from spatiotemporal observations. Within the solver, the unknown kernel is represented using a constrained Kolmogorov--Arnold Network (KAN) parameterization, with the physical constraints imposed through two different approaches: a Bernstein-polynomial-based Monotone--Convex KAN (MC-KAN), whose coefficient constraints enforce positivity, monotonic decrease, and convexity by construction, and a Chebyshev-based KAN (Cheb-KAN), in which the same properties are encouraged through soft penalty terms. After training, symbolic regression is applied to the learned kernels to obtain interpretable closed-form representations. We evaluate both methods on benchmarks spanning a one-dimensional Volterra equation, a one-dimensional viscoelastic wave partial integro-differential equation, and a two-dimensional nonlocal reaction-diffusion equation with an anisotropic coupled kernel. For the 1D problems, both methods recover the correct kernel functional form and achieve comparable solution-reconstruction accuracy. In contrast, for the sparse and noisy 2D nonlocal problem, the hard-constrained MC-KAN consistently achieves lower kernel reconstruction errors than the soft-constrained Cheb-KAN. Our results demonstrate that enforcing physically motivated shape constraints by construction provides greater robustness than soft penalties for multidimensional kernel discovery from sparse and noisy observations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。