统一处理多种磁共振采样模式,无需重训即可高保真重建多对比图像。
UniFS: Unified Multi-Contrast MRI Reconstruction via Frequency-Spatial Fusion
- 通过频域-空间融合机制,跨不同采样模式统一建模。
- 在BraTS与HCP数据集上达最新性能,对未见采样模式仍有效。
- 适合临床需快速适配新扫描方案的医学影像重建场景。
多对比磁共振重建(MCMR)近年来成为热点,利用高质量辅助模态重建欠采样的目标模态。然而现有方法通常难以泛化至不同k空间欠采样模式,需为每种模式单独训练模型,限制实际应用。为此,本文提出UniFS:一种统一的频域-空间融合模型,可在不重新训练的前提下处理多种欠采样模式。该模型包含三个关键模块:跨模态频域融合模块、基于自适应掩码的提示学习模块和双分支互补精修模块,共同提取跨模式不变特征并动态适应各自变化。现有方法多忽略频域特性或仅提取浅层频域信息,未能充分挖掘跨模态频域互补性。UniFS引入自适应提示引导的频域融合机制,显著提升模型泛化能力。我们在BraTS与HCP数据集上,针对多种欠采样模式与加速因子(包括未见过的模式)进行了全面评估。实验结果表明,UniFS在多个场景下均达到当前最优性能。代码已开源:https://github.com/LIKP0/UniFS。
原文摘要 · Abstract (English)
Recently, Multi-Contrast MR Reconstruction (MCMR) has emerged as a hot research topic that leverages high-quality auxiliary modalities to reconstruct undersampled target modalities of interest. However, existing methods often struggle to generalize across different k-space undersampling patterns, requiring the training of a separate model for each specific pattern, which limits their practical applicability. To address this challenge, we propose UniFS, a Unified Frequency-Spatial Fusion model designed to handle multiple k-space undersampling patterns for MCMR tasks without any need for retraining. UniFS integrates three key modules: a Cross-Modal Frequency Fusion module, an Adaptive Mask-Based Prompt Learning module, and a Dual-Branch Complementary Refinement module. These modules work together to extract domain-invariant features from diverse k-space undersampling patterns while dynamically adapt to their own variations. Another limitation of existing MCMR methods is their tendency to focus solely on spatial information while neglect frequency characteristics, or extract only shallow frequency features, thus failing to fully leverage complementary cross-modal frequency information. To relieve this issue, UniFS introduces an adaptive prompt-guided frequency fusion module for k-space learning, significantly enhancing the model's generalization performance. We evaluate our model on the BraTS and HCP datasets with various k-space undersampling patterns and acceleration factors, including previously unseen patterns, to comprehensively assess UniFS's generalizability. Experimental results across multiple scenarios demonstrate that UniFS achieves state-of-the-art performance. Our code is available at https://github.com/LIKP0/UniFS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。