让物理神经算子持续学习新数据,不遗忘旧知识。
Replay-Based Continual Learning for Physics-Informed Neural Operators

- 用回放机制保存旧数据,结合物理约束防止遗忘。
- 在三个力学问题上实现零标签训练,适应新数据速度快。
- 适合需要长期更新的物理模拟场景,如医疗或工程仿真。
神经算子在分布内(ID)问题上表现优异,但面对分布外(OOD)数据时性能显著下降。本文将持续学习引入基于Transolver架构的物理信息神经算子,提出一种无需标签、仅依赖输入场和物理约束的简单有效回放式持续学习策略。当新OOD数据出现时,通过基于蒸馏的约束引入少量历史数据以保留已有知识,同时采用迁移学习的LoRA实现快速适应。在流体力学中的达西渗流、生物力学中的二维脑肿瘤超弹性问题以及固体力学中的三维三重周期极小曲面线弹性问题三个代表性任务上验证,该方法有效缓解灾难性遗忘,保持对新数据的快速适应能力。相比传统联合训练,显著提升训练效率,降低额外内存占用与计算成本。
原文摘要 · Abstract (English)
Neural operators generally demonstrate strong predictive performance on in-distribution (ID) problems. However, a critical limitation of existing methods is their significant performance degradation when encountering out-of-distribution (OOD) data. To address this issue, this work introduces continual learning into physics-informed neural operators, with particular emphasis on neural operators built upon the Transolver architecture, and proposes a simple yet effective replay-based continual learning strategy. The proposed method is fully physics-informed and does not require labeled data, relying solely on input fields together with physical constraints for training. When new OOD data become available, a small number of past data are incorporated through a distillation-based constraint to preserve previously acquired knowledge and alleviate catastrophic forgetting. Meanwhile, a transfer learning LoRA is employed to enable rapid adaptation to the new data. The proposed framework is systematically validated on three representative physical problems, including the Darcy flow problem in fluid mechanics, a two-dimensional hyperelastic brain tumor problem in biomechanics, and a three-dimensional linear elastic Triply Periodic Minimal Surfaces problem in solid mechanics. The results demonstrate that the proposed method effectively mitigates catastrophic forgetting on previously learned data while maintaining fast adaptability to new data. Compared with conventional joint training strategies, the proposed method significantly improves training efficiency while reducing additional memory usage and computational cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。