用物理敏感方向保护神经算子,让仿真转真实更准且不丢核心物理规律。
PhysGuard: Fisher-Guided Gradient Projection for Sim-to-Real Neural PDE Surrogates

- 基于经验费雪信息矩阵识别关键物理参数方向,只允许非关键方向微调。
- 在严重域偏移下,低频误差降低32%,同时保持模型适应能力。
- 适合需高保真物理建模的科学计算、工程仿真等场景,尤其数据稀缺时。
在仿真数据上训练的神经算子模型常因仿真到真实(sim-to-real)差距导致实验测量精度下降。标准微调虽可缓解该问题,但可能破坏预训练阶段学习到的核心物理表征。尽管知识保留适配在视觉与语言任务中已有研究,但其是否适用于架构与知识本质不同的神经算子尚不明确。神经算子需保护的是尺度相关的物理结构,而非语义或视觉特征。本文提出PhysGuard,一种物理保真的神经算子仿真转真实适配框架。具体而言,通过在仿真数据上计算的经验费雪信息矩阵,识别出对物理至关重要的参数方向,并将微调更新限制于不干扰这些方向的子空间。采用分层格拉姆矩阵公式实现百万级参数模型的高效计算,自适应阈值自动确定保护子空间大小。谱探测实验表明,主导费雪方向与低频输出结构强相关。在四个神经算子架构及不同物理系统上的基准测试显示,相比基线方法,PhysGuard在多数评估指标上表现优异,尤其在严重域偏移下,低频误差降低最多达32%,同时维持良好适应性。代码已开源:https://github.com/ZhouChaunge/PhysGuard。
原文摘要 · Abstract (English)
Neural operator models trained on simulation data often lose accuracy when applied to experimental measurements due to the sim-to-real gap. Standard fine-tuning with limited real data can reduce this gap, but it may also damage the core physics-relevant representations learned during pretraining. Although knowledge-preserving adaptation has been widely investigated in vision or language tasks, it remains unclear whether these methods are suitable for neural operators whose architectures and protected knowledge are fundamentally different. Neural operators need to preserve core-scale physical structures rather than semantic or visual features. We propose PhysGuard, a physics-preserving framework for accurate sim-to-real adaptation of neural operators. Specifically, PhysGuard uses the empirical Fisher Information Matrix computed on simulation data to identify physics-critical parameter directions, then restricts fine-tuning updates to directions that do not interfere with them. A layer-wise Gram-matrix formulation makes this efficient for models with millions of parameters, while an adaptive threshold automatically determines the protected subspace size. A spectral probe experiment shows that the dominant Fisher directions are strongly associated with low-frequency output structures. Experiments on benchmark across four neural operator architectures and different physical systems show that PhysGuard performs strongly on most evaluation metrics compared to baselines. The benefits are most evident under severe domain shift, where it reduces low-frequency error by up to 32\% compared to standard fine-tuning while maintaining adaptability. Our code is available at https://github.com/ZhouChaunge/PhysGuard.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。