用贝叶斯生成模型联合建模数据与缺失机制,给出可信的填补结果。
Missingness-aware Data Imputation via AI-powered Bayesian Generative Modeling

- 融合神经网络与贝叶斯推断,显式建模数据和缺失过程
- 在多个数据集上优于传统方法和现有神经网络方法
- 适合需量化不确定性的高可靠性场景,如医疗、金融
缺失数据填补仍是现代数据科学中的核心挑战,尤其在需要不确定性量化时。本文提出MissBGM,一种基于贝叶斯生成建模的智能填补方法,将神经网络的表达能力与贝叶斯推断的统计严谨性相结合。不同于仅提供点估计或隐含处理缺失机制的现有方法,MissBGM显式且联合建模数据生成过程与缺失机制,为填补结果提供合理的后验不确定性,而非单一估计值。我们构建了基于随机优化的交替更新框架,对缺失值、模型参数与潜在变量进行迭代直至收敛。理论分析表明,在弱假设下,缺失值估计具有一致性。实验显示,MissBGM在广泛设置下均显著优于传统填补器与近期神经网络方法。结果验证了其作为现代缺失数据填补中原理严谨且可扩展的解决方案的潜力。代码已开源:https://github.com/liuq-lab/MissBGM。
原文摘要 · Abstract (English)
Missing data imputation remains a fundamental challenge in modern data science, especially when uncertainty quantification is essential. In this work, we propose MissBGM, an AI-powered missing data imputation method via Bayesian generative modeling that bridges the expressive flexibility of neural networks with the statistical rigor of Bayesian inference. Unlike existing methods that often focus on point estimates or treat the missingness mechanism implicitly, MissBGM explicitly and jointly models the data-generating and missingness mechanisms, providing principled posterior uncertainty over imputations rather than a single point estimate. We develop a stochastic optimization framework with alternating updates among missing values, model parameters, and latent variables until convergence. Our theoretical analysis shows that estimates of missing values from MissBGM converge consistently under mild assumptions. Empirically, we demonstrate that MissBGM achieves superior performance over traditional imputers and recent neural network-based methods across extensive experimental settings. These results establish MissBGM as a principled and scalable solution for modern missing data imputation. The code for MissBGM is open sourced at https://github.com/liuq-lab/MissBGM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。