arXiv:2604.17030cs.CV2026-04

解决多模态疾病诊断中数据缺失问题,让模型更可信。

Conditional Evidence Reconstruction and Decomposition for Interpretable Multimodal Diagnosis

论文配图:Conditional Evidence Reconstruction and Decomposition for Interpretable Multimodal Diagnosis
图 1 · 摘自论文原文
  • 根据已有数据重构缺失模态,动态捕捉个体间跨模态关系。
  • 在ADNI数据集上,不完整模态下诊断准确率优于基线方法。
  • 可解释诊断依据,适合临床医生验证决策逻辑。

神经退行性疾病具有多重病因特征,涉及遗传易感性、脑结构变化以及环境与行为因素的协同作用。为提升诊断能力,多模态建模通过整合不同数据源的互补证据被广泛应用。然而,在大规模队列和真实临床流程中,模态覆盖常不完整,导致现有模型在部分模态缺失时性能下降。当前方法多依赖群体或静态先验,难以捕捉个体特异性跨模态关联;且多数模型缺乏对决策依据的可解释性。为此,本文提出条件证据重建与分解(CERD)框架,实现可解释的不完整多模态诊断。CERD首先基于每个受试者已观测输入,条件化重建缺失模态表示;随后在逻辑值层面进行归因,将诊断证据分解为跨模态一致性支持与模态特异性线索。在阿尔茨海默病神经影像计划(ADNI)数据集上的实验表明,CERD在不完整模态设置下优于多个基准模型,并生成结构清晰、符合临床语境的证据归因,有助于建立可信的决策支持系统。

原文摘要 · Abstract (English)

Neurobiological and neurodegenerative diseases are inherently multifactorial, arising from coupled influences spanning genetic susceptibility, brain alterations, and environmental and behavioral factors. Multimodal modeling has therefore been increasingly adopted for disease diagnosis by integrating complementary evidence across data sources. However, in both large-scale cohorts and real-world clinical workflows, modality coverage is often incomplete, making many multimodal models brittle when one or more modalities are unavailable. Existing approaches to incomplete multimodal diagnosis typically rely on group-wise or static priors, which may fail to capture subject-specific cross-modal dependencies; moreover, many models provide limited interpretability into which evidence sources drive the final decision. To address these limitations, we propose Conditional Evidence Reconstruction and Decomposition (CERD), a framework for interpretable multimodal diagnosis with incomplete modalities. CERD first reconstructs missing modality representations conditioned on each subject's observed inputs, then decomposes diagnostic evidence into shared cross-modal corroboration and modality-specific cues via logit-level attribution. Experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) demonstrate that CERD outperforms competitive baselines under incomplete-modality settings while producing structured and clinically aligned evidence attributions for trustworthy decision support.

多模态诊断可解释性阿尔茨海默病证据归因

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。