用大脑宏观结构快速精准生成微观结构图像,突破多模态MRI成本限制。
Macro2Micro: A Rapid and Precise Cross-modal Magnetic Resonance Imaging Synthesis using Multi-scale Structural Brain Similarity
- 基于GAN框架,分枝处理多尺度脑结构信息以提升生成精度。
- 相比以往方法,结构相似性(SSIM)提升6.8%,保留个体生物特征。
- 推理速度<0.01秒/模态,适合临床与研究中的实时多模态成像。
人类大脑是一个复杂系统,需宏观与微观结构共同理解。但由于技术限制和多模态磁共振成像(MRI)采集成本高,两者间的非线性关系难以建模。为此,我们提出Macro2Micro,一种基于生成对抗网络(GAN)的深度学习框架,通过宏观结构预测微结构。该方法假设微结构信息可从宏观结构推断,显式将多尺度脑信息编码至不同处理分支。为提升去伪影能力和输出质量,提出简单有效的辅助判别器与学习目标。大量实验表明,Macro2Micro能准确将T1加权MRI转为对应分数各向异性(FA)图像,相较先前方法在结构相似性指数(SSIM)上提升6.8%,同时保持个体生物特征。单次模态转换推理时间低于0.01秒,具备实现实时多模态成像的潜力。代码将在论文接受后公开。
原文摘要 · Abstract (English)
The human brain is a complex system requiring both macroscopic and microscopic components for comprehensive understanding. However, mapping nonlinear relationships between these scales remains challenging due to technical limitations and the high cost of multimodal Magnetic Resonance Imaging (MRI) acquisition. To address this, we introduce Macro2Micro, a deep learning framework that predicts brain microstructure from macrostructure using a Generative Adversarial Network (GAN). Based on the hypothesis that microscale structural information can be inferred from macroscale structures, Macro2Micro explicitly encodes multiscale brain information into distinct processing branches. To enhance artifact elimination and output quality, we propose a simple yet effective auxiliary discriminator and learning objective. Extensive experiments demonstrated that Macro2Micro faithfully translates T1-weighted MRIs into corresponding Fractional Anisotropy (FA) images, achieving a 6.8\% improvement in the Structural Similarity Index Measure (SSIM) compared to previous methods, while retaining the individual biological characteristics of the brain. With an inference time of less than 0.01 seconds per MR modality translation, Macro2Micro introduces the potential for real-time multimodal rendering in medical and research applications. The code will be made available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。