提出MODE方法,让物理神经网络在新条件下快速适应且保持高效。
Manifold-Orthogonal Dual-spectrum Extrapolation for Parameterized Physics-Informed Neural Networks
- 将物理演化分解为三个互补机制:主频混叠、残差频激活和伽利略解耦。
- 在1D与2D偏微分方程上实现强跨分布泛化,参数量与SVD相当。
- 适合需要快速适配新物理场景的轻量化模型部署者使用。
物理信息神经网络(PINNs)在建模由偏微分方程(PDE)控制的动力系统方面取得了显著进展。为避免在新物理条件下重新训练带来的计算开销,参数化PINNs(P²INNs)通常采用奇异值分解(SVD)对预训练算子进行微调以应对分布外(OOD)情形。然而,基于SVD的微调常因子空间锁定和重要高频谱模式截断而受限,难以捕捉复杂物理过渡。尽管参数高效微调(PEFT)方法看似有前景,但将传统适配器如LoRA应用于P²INNs会引入严重权衡:加性更新增加参数开销并破坏算子表示中固有的物理流形结构。为此,我们提出流形正交双谱外推(MODE),一种专为物理算子适配设计的轻量级微架构。MODE将物理演化分解为三部分:主频谱密集混叠,通过冻结的正交基实现跨模态能量转移;残差频唤醒,通过单个可训练标量激活高频谱成分;仿射伽利略解耦,显式分离空间平移动力学。在1D对流-扩散-反应方程和2D赫尔姆霍兹方程等挑战性PDE基准测试中,MODE在保持原生SVD最小参数复杂度的同时,实现了出色的分布外泛化能力,并优于现有基于PEFT的基线方法。
原文摘要 · Abstract (English)
Physics-informed neural networks (PINNs) have achieved notable success in modeling dynamical systems governed by partial differential equations (PDEs). To avoid computationally expensive retraining under new physical conditions, parameterized PINNs (P$^2$INNs) commonly adapt pre-trained operators using singular value decomposition (SVD) for out-of-distribution (OOD) regimes. However, SVD-based fine-tuning often suffers from rigid subspace locking and truncation of important high-frequency spectral modes, limiting its ability to capture complex physical transitions. While parameter-efficient fine-tuning (PEFT) methods appear to be promising alternatives, applying conventional adapters such as LoRA to P$^2$INNs introduces a severe Pareto trade-off, as additive updates increase parameter overhead and disrupt the structured physical manifolds inherent in operator representations. To address these limitations, we propose Manifold-Orthogonal Dual-spectrum Extrapolation (MODE), a lightweight micro-architecture designed for physics operator adaptation. MODE decomposes physical evolution into complementary mechanisms including principal-spectrum dense mixing that enables cross-modal energy transfer within frozen orthogonal bases, residual-spectrum awakening that activates high-frequency spectral components through a single trainable scalar, and affine Galilean unlocking that explicitly isolates spatial translation dynamics. Experiments on challenging PDE benchmarks including the 1D Convection--Diffusion--Reaction equation and the 2D Helmholtz equation demonstrate that MODE achieves strong out-of-distribution generalization while preserving the minimal parameter complexity of native SVD and outperforming existing PEFT-based baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。