arXiv:2410.17691eess.IVcs.CV2024-10

用因果模型生成阿尔茨海默病脑部影像演变,预测干预效果

Longitudinal Causal Image Synthesis

  • 构建表征-视觉因果图,融合生成模型与连续时间建模
  • 在ADNI等数据集上合成高质量脑部影像,还原疾病进展轨迹
  • 适合临床研究者用于模拟治疗干预的长期影响

临床决策依赖因果推理与纵向分析。例如,阿尔茨海默病(AD)患者若干预脑脊液A-beta水平,一年后脑灰质萎缩情况如何?这一问题关乎诊断与治疗。然而,此类反事实医学影像无法通过传统仪器或基于相关性的图像合成模型获得。为此,我们提出一种因果纵向图像合成(CLIS)方法,解决三大挑战:高维图像与低维表格变量维度不匹配、随访数据采集间隔不一致、现有因果图模型对图像数据建模能力不足。本文建立表征-视觉因果图(TVCG),融合生成成像、连续时间建模与结构因果模型,并基于神经网络训练。在ADNI数据集上训练并在两个其他AD数据集上评估,结果表明合成图像质量优异且可控,合成MRI有助于刻画AD进展,验证了该方法在临床中的可靠性与实用性。

原文摘要 · Abstract (English)

Clinical decision-making relies heavily on causal reasoning and longitudinal analysis. For example, for a patient with Alzheimer's disease (AD), how will the brain grey matter atrophy in a year if intervened on the A-beta level in cerebrospinal fluid? The answer is fundamental to diagnosis and follow-up treatment. However, this kind of inquiry involves counterfactual medical images which can not be acquired by instrumental or correlation-based image synthesis models. Yet, such queries require counterfactual medical images, not obtainable through standard image synthesis models. Hence, a causal longitudinal image synthesis (CLIS) method, enabling the synthesis of such images, is highly valuable. However, building a CLIS model confronts three primary yet unmet challenges: mismatched dimensionality between high-dimensional images and low-dimensional tabular variables, inconsistent collection intervals of follow-up data, and inadequate causal modeling capability of existing causal graph methods for image data. In this paper, we established a tabular-visual causal graph (TVCG) for CLIS overcoming these challenges through a novel integration of generative imaging, continuous-time modeling, and structural causal models combined with a neural network. We train our CLIS based on the ADNI dataset and evaluate it on two other AD datasets, which illustrate the outstanding yet controllable quality of the synthesized images and the contributions of synthesized MRI to the characterization of AD progression, substantiating the reliability and utility in clinics.

因果推理医学影像纵向建模生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。