直接反向传播求解反应扩散方程参数,发现优化失败源于损失曲面的平坦区与陡峭悬崖。
Loss Landscape Diagnosis for Gradient-Based Gray-Scott System Inversion: Disentangling the Roles of PINN Components

- 直接反向传播未使用神经网络,通过展开灰-斯科特模拟进行参数反演。
- 损失曲面存在无梯度信号的平坦区,边界为对应分岔点的陡峭悬崖。
- 神经网络仅补全观测数据,无法修复病态参数空间,适合特定场景设计。
基于梯度的反应-扩散系统反演通常依赖代理模型或物理信息神经网络(PINN),而直接通过偏微分方程结构反向传播的方法长期被忽视。本文采用此直接路径作为诊断工具,将稳态损失反向传播至未展开的灰-斯科特模拟中以恢复其参数,不引入任何代理模型或神经网络。优化无法收敛,绘制损失曲面后发现失败根源在于其几何结构——平坦区域无梯度信号,边界由与分岔边界对齐的陡峭悬崖构成,该结构在不同损失函数下重复出现,且无论梯度如何传递至参数均存在。将此最小设置视为PINN的消融实验,我们解耦了各组件作用:当神经网络固定时,残差损失在PDE参数上呈二次型,生成平滑曲面,因此其本身已规避该病理,通过隐式编码所有初值下的完整动力学。神经网络则无法修复病态参数子空间,仅用于补全观测数据——这一分工此前未被明确揭示。这些发现为PINN类方法提供了具体设计启示,并给出了关于附加维度何时真正有益的更广泛启发。
原文摘要 · Abstract (English)
Gradient-based inversion of reaction-diffusion systems is typically approached via surrogate models or physics-informed neural networks (PINNs), while the most direct route, backpropagation through the PDE's structure itself, has largely been avoided. We pursue this direct route as a diagnostic probe, backpropagating a steady-state loss through unrolled Gray-Scott simulation to recover its parameters, with no surrogate or neural-network augmentation. Optimization fails to converge, and plotting the landscape directly locates the failure in its geometry -- flat plateaus with no gradient signal, bounded by sharp cliffs that align with bifurcation boundaries -- a structure that recurs across loss functions and is inherited however the gradients are routed to parameters. Reading this minimal setup as an ablation of PINN, we disentangle each component's role: with the neural network fixed, the residual loss is quadratic in the PDE parameters and yields a smooth landscape, so it alone already avoids the pathology, by implicitly encoding the full PDE dynamics across all initial conditions. The neural network, for its part, cannot repair an ill-posed parameter subspace, and so serves only to complete the observed data -- a division of labor not previously made explicit. These findings carry concrete design implications for PINN-type methods and a broader heuristic on when added dimensions actually help.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。