用降维与迁移学习提升物理引导神经网络的材料行为发现能力。
Enhancing material behavior discovery using embedding-oriented Physically-Guided Neural Networks with Internal Variables
- 通过谱分解、POD和预训练自编码器替代原解码器,降低计算开销。
- 在仅用可观测数据条件下,准确还原非线性扩散方程的本构关系。
- 支持新材料快速适配,显著减少训练时间且抗噪性强。
物理引导神经网络(PGNNIV)是仅使用可观测数据训练的科学机器学习工具,具备揭示内部状态关系的能力。其通过架构设计与损失正则化引入物理知识,使部分神经元具有物理意义的内变量。然而,面对细网格空间场或时变系统等高维数据时,模型可扩展性受限。本文提出改进方案,通过降阶建模技术提升可扩展性:采用谱分解、主成分分析(POD)及预训练自编码器作为替代解码器,实现计算效率、精度、抗噪性与泛化能力间的权衡,大幅降低计算需求。同时引入迁移学习与微调策略,复用已有知识以高效适应新材料或配置,显著缩短训练时间并维持或提升性能。以非线性扩散方程为案例,仅使用可观测数据验证,结果表明增强版PGNNIV成功识别出底层本构状态方程,兼具高预测精度、强鲁棒性、抗过拟合能力,并有效降低计算负担。所提方法可根据数据量、资源条件与建模目标灵活适配,全面克服各类场景下的可扩展性挑战。
原文摘要 · Abstract (English)
Physically Guided Neural Networks with Internal Variables are SciML tools that use only observable data for training and and have the capacity to unravel internal state relations. They incorporate physical knowledge both by prescribing the model architecture and using loss regularization, thus endowing certain specific neurons with a physical meaning as internal state variables. Despite their potential, these models face challenges in scalability when applied to high-dimensional data such as fine-grid spatial fields or time-evolving systems. In this work, we propose some enhancements to the PGNNIV framework that address these scalability limitations through reduced-order modeling techniques. Specifically, we introduce alternatives to the original decoder structure using spectral decomposition, POD, and pretrained autoencoder-based mappings. These surrogate decoders offer varying trade-offs between computational efficiency, accuracy, noise tolerance, and generalization, while improving drastically the scalability. Additionally, we integrate model reuse via transfer learning and fine-tuning strategies to exploit previously acquired knowledge, supporting efficient adaptation to novel materials or configurations, and significantly reducing training time while maintaining or improving model performance. To illustrate these various techniques, we use a representative case governed by the nonlinear diffusion equation, using only observable data. Results demonstrate that the enhanced PGNNIV framework successfully identifies the underlying constitutive state equations while maintaining high predictive accuracy. It also improves robustness to noise, mitigates overfitting, and reduces computational demands. The proposed techniques can be tailored to various scenarios depending on data availability, resources, and specific modeling objectives, overcoming scalability challenges in all the scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。