arXiv:2606.06171stat.MLcs.LG2026-06

提出有效维度新度量,解决物理神经网络中约束冲突问题

Effective Dimensionality as an Operator Invariant for Physics-Preserving Constraint Adaptation in Physics-Informed Neural Networks

论文配图:Effective Dimensionality as an Operator Invariant for Physics-Preserving Constraint Adaptation in Physics-Informed Neural Networks
图 1 · 摘自论文原文
  • 用费希尔信息矩阵定义有效维度,衡量未被微分算子约束的参数方向
  • 有效维度收敛于算子核维数,与网络结构无关,成为结构性不变量
  • 基于零空间投影实现快速边界条件适配,秒级完成且不破坏已学物理规律

物理信息神经网络因共享参数空间同时满足控制方程与边界条件,易产生任务干扰。本文通过费希尔信息矩阵量化模型的有效自由度($d_{eff}$),其定义为未受微分算子约束的参数方向维度。对于有限维核的算子,$d_{eff}$精确收敛至核维数,与网络宽度、深度或激活函数无关,使其从拟合诊断转变为连续算子的结构性不变量;对于无限维核算子,$d_{eff}$则反映网络对该核的有限维表示带宽。重要的是,$d_{eff}$可作为先验结构诊断工具:将适定问题的$d_{eff}$驱动至零,即表明物理与边界约束已吸收网络全部自由度。基于此,提出子空间投影策略进行边界适应——无需从头训练,仅将参数更新投影到预训练物理算子的零空间,即可在不扰动物理学习的前提下满足新边界条件。梯度微调虽性能相当但耗时更长且需调参,而子空间投影可在秒至分钟内达成近似等效效果。在线性与非线性算子上验证,可准确适应初始值与边界变化,以及未见过的约束类型。

原文摘要 · Abstract (English)

Physics-Informed Neural Networks inherently suffer from task interference because they rely on a shared parameter space to satisfy both governing differential equations and boundary conditions. We analyze this structural conflict using the Fisher Information Matrix to quantify the effective degrees of freedom ($d_{eff}$) in a physics-constrained model. Unlike the classical $d_{eff}$ which measures how many parameter directions are informed by data against a statistical prior, our $d_{eff}$ measures the dimension of the parameter directions unconstrained by the differential operator. For operators with finite-dimensional kernel, we show that $d_{eff}$ converges to the kernel dimension exactly, independent of network width, depth, or activation function, recasting it from a fit diagnostic into a structural invariant of the underlying continuous operator. For operators with infinite-dimensional kernel, $d_{eff}$ instead measures the network's finite-dimensional representational bandwidth for that kernel rather than recovering an integer invariant. Importantly, $d_{eff}$ also serves as an a priori structural diagnostic. Driving $d_{eff}$ of a well-posed problem to zero certifies that the physics and boundary constraints have absorbed the network's free directions. Building on this characterization, we introduce subspace projection strategies for boundary adaptation. Rather than retraining from scratch, we project parameter updates into the null space of the pre-trained physics operator so that new boundary conditions are satisfied without disturbing the learned physics. Gradient-based fine-tuning can match or exceed this but needs more wall-clock time and tuning, whereas subspace projection delivers near-equivalent quality in seconds to minutes. We validate on linear and nonlinear operators, demonstrating accurate adaptation to initial and boundary shifts and unencountered constraint types.

物理信息网络有效维度约束适配子空间投影

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。