用神经编码器融合多模态数据,实现可扩展的贝叶斯混合模型分析。
Integrating Neural Encoders in Bayesian Generalized Linear Mixed Models for Multimodal Data

- 联合训练神经编码器与贝叶斯混合模型,学习多模态表示。
- 在模拟和真实数据中均实现准确的后验均值与方差估计。
- 适合需要量化不确定性的纵向多模态研究,如医疗进展分析。
针对广义线性混合模型(GLMM)的可扩展贝叶斯推断在处理相关纵向数据时具有不确定性感知优势,但现有方法多假设低维表格型预测变量,难以直接处理图像、文本等高维模态。本文提出将一个或多个模态特定的神经编码器与GLMM目标联合学习,随后在已学习表示下对GLMM参数执行校正方差的随机梯度MCMC推断。该条件贝叶斯设计将监督表示学习与群体效应、个体异质性及模态随机斜率的后验不确定性量化相结合。模型在保留结构化协变量与学习模态可解释固定与随机效应的同时,可高效处理大规模纵向数据集。模拟研究表明,经协方差校正后,该方法能准确恢复全数据MCMC基准的后验均值与方差估计;通过参数级区间覆盖与留出数据预测校准评估不确定性。在青光眼进展与青少年心理健康应用中,框架能细致评估各模态在个体与群体层面的相对重要性,且不牺牲预测性能。
原文摘要 · Abstract (English)
Scalable Bayesian inference for generalized linear mixed models (GLMMs) provides uncertainty-aware analysis of correlated longitudinal data, but existing scalable approaches largely assume low-dimensional tabular predictors and do not directly accommodate high-dimensional modalities such as images and text. We address this limitation by learning one or more modality-specific neural encoders jointly with a GLMM objective, then performing variance-corrected stochasticgradient MCMC for the GLMM parameters conditional on the learned representation. This conditional-Bayes design combines supervised representation learning with posterior uncertainty quantification for population-level effects, subjectspecific heterogeneity, and modality-level random slopes. The resulting model preserves interpretable fixed and random effects for structured covariates and learned modalities while scaling gracefully to large longitudinal datasets. In simulation studies, our method recovers posterior means and variance estimates from full-data MCMC benchmarks after covariance correction. We further evaluate uncertainty through parameter-level interval coverage in simulations and predictive calibration on held-out data. Applications to glaucoma progression and adolescent mental health demonstrate that the framework allows nuanced assessment of the relative importance of each modality on both individual and population levels without sacrificing predictive performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。