arXiv:2411.03263cs.LGstat.ML2024-11中稿 · UAI 2025被引 2

提出无需源数据的鲁棒迁移学习方法,解决负迁移问题。

Proxy-informed Bayesian transfer learning with unknown sources

  • 用贝叶斯视角建模负迁移,识别非可迁移因素的先验误设
  • 仅需间接代理信息即可实现迁移,不依赖目标数据观测
  • 适用于无监督任务差异或仅有噪声反馈场景

跨数据源泛化需要利用关于哪些效应可迁移、哪些不可迁移的先验知识。迁移学习框架用于设定和优化这些知识。一个关键挑战是负迁移现象:引入源数据后,目标数据上的性能反而下降。本文首次从贝叶斯角度分析负迁移,提出代理信息引导的鲁棒概率迁移学习方法(PROMPT)。该方法无需知晓源数据(即源数据未知),在任务差异未被观测到(如存在潜在混杂因子)时仍有效。学习者无需访问目标任务观测数据(无法微调),而是利用间接代理信息进行推断。理论分析表明,负迁移风险不随代理信息的丰富度变化,说明PROMPT在仅有噪声间接信息(如人工反馈)时依然有效。

原文摘要 · Abstract (English)

Generalization outside the scope of one's training data requires leveraging prior knowledge about the effects that transfer, and the effects that don't, between different data sources. Transfer learning is a framework for specifying and refining this knowledge about sets of source (training) and target (prediction) data. A challenging open problem is addressing the empirical phenomenon of negative transfer, whereby the transfer learner performs worse on the target data after taking the source data into account than before. We first introduce a Bayesian perspective on negative transfer, and then a method to address it. The key insight from our formulation is that negative transfer can stem from misspecified prior information about non-transferable causes of the source data. Our proposed method, proxy-informed robust method for probabilistic transfer learning (PROMPT), does not require prior knowledge of the source data (the data sources may be "unknown"). PROMPT is thus applicable when differences between tasks are unobserved, such as in the presence of latent confounders. Moreover, the learner need not have access to observations in the target task (may not have the ability to "fine-tune"), and instead makes use of proxy (indirect) information. Our theoretical results show that the threat of negative transfer does not depend on the informativeness of the proxy information, highlighting the usefulness of PROMPT in cases where only noisy indirect information, such as human feedback, is available.

迁移学习贝叶斯方法负迁移代理信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。