用三阶段贝叶斯迁移学习提升数据稀缺场景的预测精度
A Three-Stage Bayesian Transfer Learning Framework to Improve Predictions in Data-Scarce Domains
- 分三阶段:先预训练特征提取器,再用对抗网络优化,最后构建贝叶斯网络细调
- 在矩形通道临界热流密度预测中,比传统方法准确率显著提升
- 适合核工程等数据少但需可靠不确定度估计的领域
机器学习在工程中的应用日益广泛,深度神经网络因性能优越被广泛应用,但其训练依赖大量高质量数据。实验数据常稀疏、噪声大或不足,难以构建鲁棒的数据驱动模型。迁移学习通过利用数据丰富的源域辅助数据稀缺的目标域学习,已证明有效。参数迁移虽常见,但在领域差异大时性能下降。域对抗神经网络(DANN)通过学习域不变表示,可缓解此问题,但训练不稳定且缺乏不确定性量化能力。本文提出全监督三阶段框架——分阶段贝叶斯域对抗神经网络(staged B-DANN),结合参数迁移与共享潜在空间适应。第一阶段在源域上训练确定性特征提取器;第二阶段用DANN对抗性优化特征提取器;第三阶段在适配后的特征提取器上构建贝叶斯神经网络,在目标域进行微调,以应对条件变化并提供校准的不确定性估计。该方法首先在合成基准上验证,显著优于标准迁移技术;随后应用于矩形通道临界热流密度预测任务,以管式实验数据为源域。结果表明,staged B-DANN能提升预测准确性与泛化能力,有望助力核工程等领域。
原文摘要 · Abstract (English)
The use of ML in engineering has grown steadily to support a wide array of applications. Among these methods, deep neural networks have been widely adopted due to their performance and accessibility, but they require large, high-quality datasets. Experimental data are often sparse, noisy, or insufficient to build resilient data-driven models. Transfer learning, which leverages relevant data-abundant source domains to assist learning in data-scarce target domains, has shown efficacy. Parameter transfer, where pretrained weights are reused, is common but degrades under large domain shifts. Domain-adversarial neural networks (DANNs) help address this issue by learning domain-invariant representations, thereby improving transfer under greater domain shifts in a semi-supervised setting. However, DANNs can be unstable during training and lack a native means for uncertainty quantification. This study introduces a fully-supervised three-stage framework, the staged Bayesian domain-adversarial neural network (staged B-DANN), that combines parameter transfer and shared latent space adaptation. In Stage 1, a deterministic feature extractor is trained on the source domain. This feature extractor is then adversarially refined using a DANN in Stage 2. In Stage 3, a Bayesian neural network is built on the adapted feature extractor for fine-tuning on the target domain to handle conditional shifts and yield calibrated uncertainty estimates. This staged B-DANN approach was first validated on a synthetic benchmark, where it was shown to significantly outperform standard transfer techniques. It was then applied to the task of predicting critical heat flux in rectangular channels, leveraging data from tube experiments as the source domain. The results of this study show that the staged B-DANN method can improve predictive accuracy and generalization, potentially assisting other domains in nuclear engineering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。