提出多模态分解学习模型,精准识别共享与独有特征提升预测性能。
Supervised Multi-Modal Fission Learning
- 通过监督信号分离全局共享、部分共享和模态特有成分
- 在完整与缺失数据场景下均优于现有方法,提升阿尔茨海默病早期预测精度
- 适用于神经影像与基因组融合分析,揭示跨模态关联机制
多模态数据学习可利用互补信息提升预测性能。现有潜在变量方法通常仅提取全模态共享成分或同时提取共享与模态特有成分。为弥补这一不足,本文提出多模态分裂学习(MMFL)模型,能同时识别多模态数据中全局共享、部分共享及各模态特有的潜在成分。与已有方法不同,MMFL利用响应变量的监督信号来筛选具有预测能力的潜在成分,并天然支持不完整多模态数据的处理。仿真研究显示,无论在完整或缺失模态情形下,MMFL均显著优于多种现有算法。在阿尔茨海默病神经影像计划(ADNI)数据集上的真实案例研究中,利用多模态神经影像与基因组数据,MMFL实现了更高准确率的早期预测,并提供了更深入的模态内与跨模态相关性洞察。
原文摘要 · Abstract (English)
Learning from multimodal datasets can leverage complementary information and improve performance in prediction tasks. A commonly used strategy to account for feature correlations in high-dimensional datasets is the latent variable approach. Several latent variable methods have been proposed for multimodal datasets. However, these methods either focus on extracting the shared component across all modalities or on extracting both a shared component and individual components specific to each modality. To address this gap, we propose a Multi-Modal Fission Learning (MMFL) model that simultaneously identifies globally joint, partially joint, and individual components underlying the features of multimodal datasets. Unlike existing latent variable methods, MMFL uses supervision from the response variable to identify predictive latent components and has a natural extension for incorporating incomplete multimodal data. Through simulation studies, we demonstrate that MMFL outperforms various existing multimodal algorithms in both complete and incomplete modality settings. We applied MMFL to a real-world case study for early prediction of Alzheimers Disease using multimodal neuroimaging and genomics data from the Alzheimers Disease Neuroimaging Initiative (ADNI) dataset. MMFL provided more accurate predictions and better insights into within- and across-modality correlations compared to existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。