用AI从普通MRI生成增强MRI,无需注射造影剂
Interactive Gadolinium-Free MRI Synthesis: A Transformer with Localization Prompt Learning
- 用分层Transformer和定位提示学习合成增强影像
- 可交互输入诊断提示,医生参与生成过程
- 适合放射科医生辅助诊断,提升安全性
对比增强磁共振成像(CE-MRI)对肿瘤检测至关重要,但钆基对比剂(GBCAs)存在潜在健康风险。为在保证诊断准确性的同时规避此问题,我们提出一种基于定位提示学习的Transformer框架(TLP),仅通过非增强MR图像合成CE-MRI。该架构包含三项创新:分层骨干网络利用高效Transformer处理多尺度特征;多阶段融合系统由局部与全局融合模块构成,分别通过空间注意力和交叉注意力整合互补信息;模糊提示生成(FPG)模块通过随机特征扰动模拟放射科医生的手动标注,提升模型泛化能力。框架支持推理时交互式输入诊断提示,实现人工智能与临床经验协同。本研究建立了一种无钆造影剂的MRI合成新范式,满足临床安全诊断需求。代码已公开于 https://github.com/ChanghuiSu/TLP。
原文摘要 · Abstract (English)
Contrast-enhanced magnetic resonance imaging (CE-MRI) is crucial for tumor detection and diagnosis, but the use of gadolinium-based contrast agents (GBCAs) in clinical settings raises safety concerns due to potential health risks. To circumvent these issues while preserving diagnostic accuracy, we propose a novel Transformer with Localization Prompts (TLP) framework for synthesizing CE-MRI from non-contrast MR images. Our architecture introduces three key innovations: a hierarchical backbone that uses efficient Transformer to process multi-scale features; a multi-stage fusion system consisting of Local and Global Fusion modules that hierarchically integrate complementary information via spatial attention operations and cross-attention mechanisms, respectively; and a Fuzzy Prompt Generation (FPG) module that enhances the TLP model's generalization by emulating radiologists' manual annotation through stochastic feature perturbation. The framework uniquely enables interactive clinical integration by allowing radiologists to input diagnostic prompts during inference, synergizing artificial intelligence with medical expertise. This research establishes a new paradigm for contrast-free MRI synthesis while addressing critical clinical needs for safer diagnostic procedures. Codes are available at https://github.com/ChanghuiSu/TLP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。