用极少配对数据实现高保真脑部MRI图像生成,还能保留病灶信息。
Fully Guided Neural Schrödinger bridge for Brain MR image synthesis
- 基于薛定谔桥框架,分两阶段迭代生成与路径学习
- 仅需少量配对数据即可在多分辨率下稳定生成
- 可融合专家标注,精准保留病变等临床关键特征
多模态脑部MRI为临床诊断提供关键互补信息,但实际中获取所有模态常受时间和成本限制。现有方法分为成对与非成对两类:成对方法精度高,但大规模配对数据难获取;非成对方法虽更可扩展,却常无法保留重要解剖结构(如病灶)。本文提出全引导薛定谔桥(FGSB),可在极少量配对数据下实现高保真生成。当有病灶特异性先验(如专家标注或分割掩码)时,模型能有效保留临床相关病灶。该框架包含两个阶段:(1) 利用源图像与高斯噪声迭代优化合成图像;(2) 通过建模中间状态学习最优变换路径,确保一致性与高保真度。跨多个数据集的实验表明,FGSB在不同成像分辨率与采集环境下均表现可靠。引入病灶先验后,临床关键特征的保留能力进一步提升。
原文摘要 · Abstract (English)
Multi-modal brain MRI provides essential complementary information for clinical diagnosis. However, acquiring all modalities in practice is often constrained by time and cost. To address this, various methods have been proposed to generate missing modalities from available ones. Existing approaches can be broadly categorized into two types: paired and unpaired methods. While paired methods achieve high synthesis accuracy, obtaining large-scale paired datasets is typically impractical. In contrast, unpaired methods, though more scalable, often fail to preserve critical anatomical features, such as lesions. In this paper, we propose Fully Guided Schrödinger Bridge (FGSB), a novel framework designed to overcome these limitations by enabling high-fidelity generation with extremely limited paired data. When lesion-specific information, such as expert annotations or segmentation masks, is available, FGSB preserves clinically relevant lesions during missing modality synthesis. Our model comprises two stages: (1) a generation stage that iteratively refines synthetic images using paired source images and Gaussian noise, and (2) a training stage that learns optimal transformation pathways by modeling intermediate states to ensure consistent, high-fidelity synthesis. Experimental results across multiple datasets demonstrate that FGSB achieves reliable synthesis performance across diverse imaging resolutions and data acquisition environments. In addition, incorporating lesion-specific priors further enhances the preservation of clinically relevant features.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。