提出双正则化高斯过程,解决异构迁移学习中的输入不匹配与负迁移问题。
R^2-HGP: A Double-Regularized Gaussian Process for Heterogeneous Transfer Learning
- 用可训练映射对齐异构输入空间,实现跨域知识迁移
- 通过稀疏性惩罚自动筛选有效源数据,抑制负迁移现象
- 融合物理规律作为正则项,提升模型可解释性与稳定性
多输出高斯过程(MGP)因其灵活性和不确定性量化能力,在多源迁移学习中备受关注,能够捕捉任务间的相关性。然而在异构迁移场景下仍存在三大挑战:源域与目标域输入空间异质,导致直接知识迁移困难;传统方法忽视先验知识与物理信息,影响领域专有洞察的利用,造成映射不稳定;不当的信息共享易引发负迁移。本文提出双正则化异构高斯过程框架(R^2-HGP),首先引入可训练先验概率映射模型对齐异构输入空间,将对齐后的输入作为潜在变量,构建多源迁移高斯过程模型,并整合进基于条件变分自编码器(CVAE)的新框架。进一步引入物理信息作为正则项,确保对齐结果符合已知物理规律。在多源迁移高斯过程中,对迁移系数施加稀疏性惩罚,实现对最相关信息源的自适应选择,抑制负迁移。大量仿真与真实工程案例验证了R^2-HGP的有效性,在多种评估指标上持续优于现有先进基准。
原文摘要 · Abstract (English)
Multi-output Gaussian process (MGP) models have attracted significant attention for their flexibility and uncertainty-quantification capabilities, and have been widely adopted in multi-source transfer learning scenarios due to their ability to capture inter-task correlations. However, they still face several challenges in transfer learning. First, the input spaces of the source and target domains are often heterogeneous, which makes direct knowledge transfer difficult. Second, potential prior knowledge and physical information are typically ignored during heterogeneous transfer, hampering the utilization of domain-specific insights and leading to unstable mappings. Third, inappropriate information sharing among target and sources can easily lead to negative transfer. Traditional models fail to address these issues in a unified way. To overcome these limitations, this paper proposes a Double-Regularized Heterogeneous Gaussian Process framework (R^2-HGP). Specifically, a trainable prior probability mapping model is first proposed to align the heterogeneous input domains. The resulting aligned inputs are treated as latent variables, upon which a multi-source transfer GP model is constructed and the entire structure is integrated into a novel conditional variational autoencoder (CVAE) based framework. Physical insights is further incorporated as a regularization term to ensure that the alignment results adhere to known physical knowledge. Next, within the multi-source transfer GP model, a sparsity penalty is imposed on the transfer coefficients, enabling the model to adaptively select the most informative source outputs and suppress negative transfer. Extensive simulations and real-world engineering case studies validate the effectiveness of our R^2-HGP, demonstrating consistent superiority over state-of-the-art benchmarks across diverse evaluation metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。