arXiv:2409.08463eess.IV2024-09中稿 · MICCAI 20224被引 6

提出评估脑部MRI生成质量的新框架,提升解剖合理性量化精度。

Evaluating the Quality of Brain MRI Generators

  • 统一处理真实MRI,标准化模型实现,自动分割生成图像
  • 仅3个模型生成的95%以上图像分割结果可靠
  • 与人工观察一致,适合神经科学生成模型质量评估

生成结构化脑部MRI的深度学习模型可加速神经科学研究,但其质量评估受限于原有自然图像指标(如SSIM、FID)。我们在超过3000张脑部MRI上对比6个先进生成模型发现,这些指标对实验设置敏感,且无法有效评估脑区宏观结构的解剖合理性。为此,我们提出新评估框架:统一处理真实MRI,标准化模型实现,并自动分割生成图像以量化解剖合理性。该框架严格检验分割可靠性,这是以往研究常忽略的关键步骤。结果表明,仅有3个模型生成的图像中至少95%具备高可靠性分割。更重要的是,该框架的评估结果与定性分析高度一致,验证了方法有效性。

原文摘要 · Abstract (English)

Deep learning models generating structural brain MRIs have the potential to significantly accelerate discovery of neuroscience studies. However, their use has been limited in part by the way their quality is evaluated. Most evaluations of generative models focus on metrics originally designed for natural images (such as structural similarity index and Frechet inception distance). As we show in a comparison of 6 state-of-the-art generative models trained and tested on over 3000 MRIs, these metrics are sensitive to the experimental setup and inadequately assess how well brain MRIs capture macrostructural properties of brain regions (i.e., anatomical plausibility). This shortcoming of the metrics results in inconclusive findings even when qualitative differences between the outputs of models are evident. We therefore propose a framework for evaluating models generating brain MRIs, which requires uniform processing of the real MRIs, standardizing the implementation of the models, and automatically segmenting the MRIs generated by the models. The segmentations are used for quantifying the plausibility of anatomy displayed in the MRIs. To ensure meaningful quantification, it is crucial that the segmentations are highly reliable. Our framework rigorously checks this reliability, a step often overlooked by prior work. Only 3 of the 6 generative models produced MRIs, of which at least 95% had highly reliable segmentations. More importantly, the assessment of each model by our framework is in line with qualitative assessments, reinforcing the validity of our approach.

MRI生成解剖评估生成模型可靠性验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。