用变形场生成新脑结构,更精准控制年龄性别等特征。
Generating Novel Brain Morphology by Deforming Learned Templates
- 基于学习模板和变形场生成3D脑MRI,不直接合成图像。
- 在图像多样性与条件一致性上优于扩散模型等基线方法。
- 适合需要精细解剖结构控制的医学生成研究。
针对3D结构化脑部MRI生成中形态合理且属性可控(如年龄、性别、疾病状态)样本的需求,现有基于GAN或扩散模型的方法直接合成图像,难以捕捉复杂解剖细节。本文提出基于先进潜空间扩散模型(LDM)的MorphLDM方法,通过将合成的变形场应用于学习得到的模板来生成新图像。不同于传统以重建为目标的自编码器,我们的编码器输出融合图像与模板的潜在嵌入,该模板由模板解码器生成;该潜在表示输入变形场解码器,其输出用于变形模板。通过最小化原始图像与形变后模板间的配准损失,联合优化编码器与两个解码器。实验表明,本方法在图像多样性、条件遵循度及体素形态测量指标上均优于生成基线模型。代码已公开于https://github.com/alanqrwang/morphldm。
原文摘要 · Abstract (English)
Designing generative models for 3D structural brain MRI that synthesize morphologically-plausible and attribute-specific (e.g., age, sex, disease state) samples is an active area of research. Existing approaches based on frameworks like GANs or diffusion models synthesize the image directly, which may limit their ability to capture intricate morphological details. In this work, we propose a 3D brain MRI generation method based on state-of-the-art latent diffusion models (LDMs), called MorphLDM, that generates novel images by applying synthesized deformation fields to a learned template. Instead of using a reconstruction-based autoencoder (as in a typical LDM), our encoder outputs a latent embedding derived from both an image and a learned template that is itself the output of a template decoder; this latent is passed to a deformation field decoder, whose output is applied to the learned template. A registration loss is minimized between the original image and the deformed template with respect to the encoder and both decoders. Empirically, our approach outperforms generative baselines on metrics spanning image diversity, adherence with respect to input conditions, and voxel-based morphometry. Our code is available at https://github.com/alanqrwang/morphldm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。