arXiv:2606.05365stat.MLcs.LG2026-06

通过经验贝叶斯方法提升跨环境预测的鲁棒性。

Environment-Robust Representation Learning with Empirical Bayes

  • 构建贝叶斯模型,分离环境变化与稳定机制
  • 在天文、微生物和重症预测中均优于现有方法
  • 适合处理数据分布随环境变化的场景

我们研究多环境预测问题。假设环境改变潜在变量的分布,但给定该变量后,观测协变量与目标的生成机制保持稳定。例如,不同医院患者潜在状态的流行率可能不同,但状态与生理指标、结果之间的关系不变。基于多个环境的数据,我们建立贝叶斯模型并推导变分目标函数。该目标分解为每个环境的项及由模型结构引入的跨环境平衡项。采用经验贝叶斯方法设定先验并融入目标函数。基于此,开发了可扩展的变分算法用于后验近似,并利用学习到的潜变量在新环境中进行预测。通过模拟及真实世界研究(包括天体源识别、基于微生物组的疾病检测和ICU脓毒症预测)验证,本方法在新环境中的预测性能显著优于以往方法。

原文摘要 · Abstract (English)

We consider multi-environment prediction problems. We assume the environments change the distribution of a latent variable, while the mechanisms generating observed covariates and targets remain stable conditional on that variable. For example, hospitals or clinical cohorts may differ in the prevalence of latent patient states, even though the relationships between those states, physiological measurements, and outcomes remain unchanged. Given a dataset from multiple environments, we formulate a Bayesian model for such problems and derive the corresponding variational objective. We show that this objective decomposes into per-environment terms and an additional cross-environment balancing term induced by the model's structure. We use an empirical Bayes method to set the prior and incorporate it into the objective. Based on this objective, we develop an amortized variational algorithm for posterior approximation, and use the resulting learned latent variables to form predictions in new environments.We study our approach through simulations and real-world studies of astronomical source identification, microbiome-based disease detection, and ICU sepsis prediction. Across these settings, our method outperforms previous approaches for prediction in new environments.

贝叶斯建模跨环境预测鲁棒学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。