让贝叶斯推断模型持续学习真实数据,避免遗忘旧知识。
Unsupervised Continual Learning for Amortized Bayesian Inference
- 分离仿真预训练与真实数据上的无监督持续学习
- 用记忆回放或参数保护防止模型遗忘旧任务
- 在多个任务中表现优于传统方法,接近马尔可夫链蒙特卡洛结果
折算贝叶斯推断(ABI)通过在模拟数据上训练生成神经网络,实现高效的后验估计,但常因模型误设导致性能下降。尽管在无标签真实数据上进行自一致性(SC)训练可提升鲁棒性,现有方法仅适用于静态单任务场景,无法处理顺序到达的数据或分布变化。本文提出一种针对ABI的持续学习框架,将基于模拟的预训练与无监督序列化SC微调分离。为应对灾难性遗忘,引入两种适应策略:(1) 带周期性重放的SC,利用记忆缓冲区保存过往观测;(2) 带弹性权重巩固的SC,通过正则化保留关键参数更新。在三个不同案例研究中,所提方法显著缓解遗忘问题,得到的后验估计优于标准仿真训练,更接近马尔可夫链蒙特卡洛(MCMC)参考解,为跨多种任务的可信ABI提供了可行路径。
原文摘要 · Abstract (English)
Amortized Bayesian Inference (ABI) enables efficient posterior estimation using generative neural networks trained on simulated data, but often suffers from performance degradation under model misspecification. While self-consistency (SC) training on unlabeled empirical data can enhance network robustness, current approaches are limited to static, single-task settings and fail to handle sequentially arriving data or distribution shifts. We propose a continual learning framework for ABI that decouples simulation-based pre-training from unsupervised sequential SC fine-tuning on real-world data. To address the challenge of catastrophic forgetting, we introduce two adaptation strategies: (1) SC with episodic replay, utilizing a memory buffer of past observations, and (2) SC with elastic weight consolidation, which regularizes updates to preserve task-critical parameters. Across three diverse case studies, our methods significantly mitigate forgetting and yield posterior estimates that outperform standard simulation-based training, achieving estimates closer to MCMC reference, providing a viable path for trustworthy ABI across a range of different tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。