arXiv:2502.02555eess.IVcs.CV2025-02中稿 · ICASSP 2025被引 2

用多模态注意力机制,从低剂量MRI生成早期和晚期增强的前列腺MRI。

AAD-DCE: An Aggregated Multimodal Attention Mechanism for Early and Late Dynamic Contrast Enhanced Prostate MRI Synthesis

  • 融合T2W、ADC和未增强T1图像,通过全局与局部注意力判别器引导生成。
  • 在ProstateX数据集上,早期和晚期合成图像分别提升0.64dB PSNR和0.1dB PSNR。
  • 适合需要无钆对比剂MRI的临床研究者和医学影像算法开发者。

动态对比增强磁共振成像(DCE-MRI)对异常病灶血流灌注的可视化和活检建议至关重要,但需注射钆对比剂,存在毒性风险。现有深度学习方法多基于单模态非增强或低剂量对比的MRI,忽视解剖区域内的灌注信息。本文提出AAD-DCE,一种包含全局与局部判别器的生成对抗网络,通过空间嵌入注意力图驱动生成早期和晚期响应的DCE-MRI图像。模型使用T2加权(T2W)、表观扩散系数(ADC)及增强前T1图像作为多模态输入。在ProstateX数据集上的大量对比与消融实验表明:(i) 模型对不同生成器基准具有鲁棒性;(ii) 在早期响应下,相比其他方法提升0.64 dB PSNR、0.0518 SSIM、降低0.015 MAE;晚期响应下提升0.1 dB PSNR、0.0424 SSIM、降低0.021 MAE;(iii) 验证了注意力集成的重要性。代码已开源。

原文摘要 · Abstract (English)

Dynamic Contrast-Enhanced Magnetic Resonance Imaging (DCE-MRI) is a medical imaging technique that plays a crucial role in the detailed visualization and identification of tissue perfusion in abnormal lesions and radiological suggestions for biopsy. However, DCE-MRI involves the administration of a Gadolinium based (Gad) contrast agent, which is associated with a risk of toxicity in the body. Previous deep learning approaches that synthesize DCE-MR images employ unimodal non-contrast or low-dose contrast MRI images lacking focus on the local perfusion information within the anatomy of interest. We propose AAD-DCE, a generative adversarial network (GAN) with an aggregated attention discriminator module consisting of global and local discriminators. The discriminators provide a spatial embedded attention map to drive the generator to synthesize early and late response DCE-MRI images. Our method employs multimodal inputs - T2 weighted (T2W), Apparent Diffusion Coefficient (ADC), and T1 pre-contrast for image synthesis. Extensive comparative and ablation studies on the ProstateX dataset show that our model (i) is agnostic to various generator benchmarks and (ii) outperforms other DCE-MRI synthesis approaches with improvement margins of +0.64 dB PSNR, +0.0518 SSIM, -0.015 MAE for early response and +0.1 dB PSNR, +0.0424 SSIM, -0.021 MAE for late response, and (ii) emphasize the importance of attention ensembling. Our code is available at https://github.com/bhartidivya/AAD-DCE.

MRI生成注意力机制多模态前列腺影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。