arXiv:2501.18328cs.CVcs.AI2025-01中稿 · CVPR被引 4

用编码预测方法实现脑部MRI任意缺失模态的虚拟补全,提升临床扫描效率。

Virtual Full-stack Scanning of Brain MRI via Imputing Any Quantised Code

  • 将多模态MRI补全转化为区域级编码预测任务,统一建模不同输入输出组合。
  • 在IXI和BraTS 2023数据集上均超越现有方法,重建质量显著提升。
  • 适用于跨患者、跨协议的通用场景,适合医学影像研究与临床辅助开发。

磁共振成像(MRI)是一种强大的多模态成像技术,可提供丰富的解剖信息。然而,在临床实践中,由于扫描时间和成本限制,难以获取所有相关模态。虚拟全栈扫描旨在从不完整采集中推断缺失模态,以低成本提升数据完整性和临床可用性。现有方法通常依赖全局条件或模态特异性设计,限制了其在不同患者群体和成像协议间的泛化能力。为此,我们提出CodeBrain,一种统一框架,将各种“任意到任意”的补全任务重新表述为区域级全栈编码预测问题。CodeBrain采用两阶段流程:(1) 通过区域级标量量化编码,学习完整模态集的紧凑表示,解码后可实现高保真图像重建;(2) 训练投影编码器,基于分级设计从不完整模态中预测全栈编码图,适应多样补全场景。在两个公开脑部MRI数据集IXI和BraTS 2023上的大量实验表明,CodeBrain持续优于现有最优方法,建立新的统一脑部MRI补全基准,推动虚拟全栈扫描发展。代码将开源于https://github.com/ycwu1997/CodeBrain。

原文摘要 · Abstract (English)

Magnetic resonance imaging (MRI) is a powerful and versatile imaging technique, offering a wide spectrum of information about the anatomy by employing different acquisition modalities. However, in the clinical workflow, it is impractical to collect all relevant modalities due to the scan time and cost constraints. Virtual full-stack scanning aims to impute missing MRI modalities from available but incomplete acquisitions, offering a cost-efficient solution to enhance data completeness and clinical usability. Existing imputation methods often depend on global conditioning or modality-specific designs, which limit their generalisability across patient cohorts and imaging protocols. To address these limitations, we propose CodeBrain, a unified framework that reformulates various ``any-to-any'' imputation tasks as a region-level full-stack code prediction problem. CodeBrain adopts a two-stage pipeline: (1) it learns the compact representation of a complete MRI modality set by encoding it into scalar-quantised codes at the region level, enabling high-fidelity image reconstruction after decoding these codes along with modality-agnostic common features; (2) it trains a projection encoder to predict the full-stack code map from incomplete modalities via a grading-based design for diverse imputation scenarios. Extensive experiments on two public brain MRI datasets, i.e., IXI and BraTS 2023, demonstrate that CodeBrain consistently outperforms state-of-the-art methods, establishing a new benchmark for unified brain MRI imputation and enabling virtual full-stack scanning. Our code will be released at https://github.com/ycwu1997/CodeBrain.

MRI补全编码预测医学影像虚拟扫描

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。