arXiv:2501.08163eess.IVcs.CV2025-01被引 6

用双域分层Mamba模型提升加速MRI重建效率与质量

DH-Mamba: Exploring Dual-domain Hierarchical State Space Models for MRI Reconstruction

  • 在k空间采用环形扫描实现频谱序列化,保留频域结构信息
  • 分层扫描策略降低长程遗忘,计算成本更低且性能更优
  • 引入局部多样性模块增强复杂结构的表征能力,适合医学图像

加速MRI重建因k空间大幅欠采样而成为极具挑战性的病态逆问题。尽管深度神经网络如CNN和ViT显著提升了性能,但仍面临全局感受野与高效计算之间的权衡。本文探索了选择性状态空间模型(Mamba)这一新范式,其具有线性复杂度,适用于长距离依赖建模。然而直接应用于MRI重建存在三大问题:(1) 传统Mamba将2D图像展平为行/列一维序列,破坏k空间频谱结构,忽视其学习潜力;(2) 现有方法采用多方向像素级展开,导致长程遗忘且计算负担重;(3) Mamba对空间变化内容表征能力有限,局部表达多样性不足。为此,本文提出双域分层Mamba:(1) 首次在k空间中应用视觉Mamba,设计环形扫描以利于全局频谱建模;(2) 提出图像与k空间双域分层扫描策略,有效缓解长程遗忘,实现效率与性能更好平衡;(3) 设计局部多样性增强模块,提升Mamba对空间变化内容的表征能力。在三个公开数据集上,针对多种欠采样模式进行大量实验,结果表明本方法显著优于现有先进方法,且计算成本更低。

原文摘要 · Abstract (English)

The accelerated MRI reconstruction poses a challenging ill-posed inverse problem due to the significant undersampling in k-space. Deep neural networks, such as CNNs and ViTs, have shown substantial performance improvements for this task while encountering the dilemma between global receptive fields and efficient computation. To this end, this paper explores selective state space models (Mamba), a new paradigm for long-range dependency modeling with linear complexity, for efficient and effective MRI reconstruction. However, directly applying Mamba to MRI reconstruction faces three significant issues: (1) Mamba typically flattens 2D images into distinct 1D sequences along rows and columns, disrupting k-space's unique spectrum and leaving its potential in k-space learning unexplored. (2) Existing approaches adopt multi-directional lengthy scanning to unfold images at the pixel level, leading to long-range forgetting and high computational burden. (3) Mamba struggles with spatially-varying contents, resulting in limited diversity of local representations. To address these, we propose a dual-domain hierarchical Mamba for MRI reconstruction from the following perspectives: (1) We pioneer vision Mamba in k-space learning. A circular scanning is customized for spectrum unfolding, benefiting the global modeling of k-space. (2) We propose a hierarchical Mamba with an efficient scanning strategy in both image and k-space domains. It mitigates long-range forgetting and achieves a better trade-off between efficiency and performance. (3) We develop a local diversity enhancement module to improve the spatially-varying representation of Mamba. Extensive experiments are conducted on three public datasets for MRI reconstruction under various undersampling patterns. Comprehensive results demonstrate that our method significantly outperforms state-of-the-art methods with lower computational cost.

MRI重建Mamba双域建模医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。