arXiv:2606.11258cs.LGnlin.PS2026-06中稿 · ICML被引 1

直接反向传播求解反应扩散方程参数,发现优化失败源于损失曲面的平坦区与陡峭悬崖。

Loss Landscape Diagnosis for Gradient-Based Gray-Scott System Inversion: Disentangling the Roles of PINN Components

论文配图:Loss Landscape Diagnosis for Gradient-Based Gray-Scott System Inversion: Disentangling the Roles of PINN Components
图 1 · 摘自论文原文
  • 直接反向传播未使用神经网络,通过展开灰-斯科特模拟进行参数反演。
  • 损失曲面存在无梯度信号的平坦区,边界为对应分岔点的陡峭悬崖。
  • 神经网络仅补全观测数据,无法修复病态参数空间,适合特定场景设计。

基于梯度的反应-扩散系统反演通常依赖代理模型或物理信息神经网络(PINN),而直接通过偏微分方程结构反向传播的方法长期被忽视。本文采用此直接路径作为诊断工具,将稳态损失反向传播至未展开的灰-斯科特模拟中以恢复其参数,不引入任何代理模型或神经网络。优化无法收敛,绘制损失曲面后发现失败根源在于其几何结构——平坦区域无梯度信号,边界由与分岔边界对齐的陡峭悬崖构成,该结构在不同损失函数下重复出现,且无论梯度如何传递至参数均存在。将此最小设置视为PINN的消融实验,我们解耦了各组件作用:当神经网络固定时,残差损失在PDE参数上呈二次型,生成平滑曲面,因此其本身已规避该病理,通过隐式编码所有初值下的完整动力学。神经网络则无法修复病态参数子空间,仅用于补全观测数据——这一分工此前未被明确揭示。这些发现为PINN类方法提供了具体设计启示,并给出了关于附加维度何时真正有益的更广泛启发。

原文摘要 · Abstract (English)

Gradient-based inversion of reaction-diffusion systems is typically approached via surrogate models or physics-informed neural networks (PINNs), while the most direct route, backpropagation through the PDE's structure itself, has largely been avoided. We pursue this direct route as a diagnostic probe, backpropagating a steady-state loss through unrolled Gray-Scott simulation to recover its parameters, with no surrogate or neural-network augmentation. Optimization fails to converge, and plotting the landscape directly locates the failure in its geometry -- flat plateaus with no gradient signal, bounded by sharp cliffs that align with bifurcation boundaries -- a structure that recurs across loss functions and is inherited however the gradients are routed to parameters. Reading this minimal setup as an ablation of PINN, we disentangle each component's role: with the neural network fixed, the residual loss is quadratic in the PDE parameters and yields a smooth landscape, so it alone already avoids the pathology, by implicitly encoding the full PDE dynamics across all initial conditions. The neural network, for its part, cannot repair an ill-posed parameter subspace, and so serves only to complete the observed data -- a division of labor not previously made explicit. These findings carry concrete design implications for PINN-type methods and a broader heuristic on when added dimensions actually help.

PINN损失曲面反演

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。