arXiv:2412.06445eess.IVcs.CV2024-12

将超声心动图转为清晰的核磁共振图像,提升诊断准确性

Echocardiography to Cardiac MRI View Transformation for Real-Time Blind Restoration

  • 用循环一致性GAN学习超声到核磁的图像转换
  • 医生评估显示合成核磁图78.9%优于原始超声
  • 适用于资源有限医院提升心脏影像诊断能力

超声心动图是监测心脏功能最常用的影像手段,常用于心肌缺血和梗死的早期发现。但其常受传感器噪声、对比度不足、严重饱和及心肌段缺失等伪影影响,限制了临床诊断应用。近年来虽有机器学习方法改善超声图像,但多针对单一问题(如去噪),难以通用可靠。相比之下,心脏核磁共振(Cardiac MRI)图像清晰,无此类严重问题,但因成本高昂,仅少数大型医院可负担。本研究提出一种新方法,将超声心动图转换为心脏核磁视图。构建了包含真实超声与核磁图像对的Echo2MRI数据集并公开共享。训练专用循环一致生成对抗网络(Cycle-GAN),实现从超声帧到核磁视图的映射。定性评估表明,该方法能从超声序列合成高质量、无伪影的合成核磁图像。多位心脏病专家评估显示,合成核磁图与真实核磁图无法区分,且在78.9%的病例中优于原始超声序列,更利于诊断。

原文摘要 · Abstract (English)

Echocardiography is the most widely used imaging to monitor cardiac functions, serving as the first line in early detection of myocardial ischemia and infarction. However, echocardiography often suffers from several artifacts including sensor noise, lack of contrast, severe saturation, and missing myocardial segments which severely limit its usage in clinical diagnosis. In recent years, several machine learning methods have been proposed to improve echocardiography views. Yet, these methods usually address only a specific problem (e.g. denoising) and thus cannot provide a robust and reliable restoration in general. On the other hand, cardiac MRI provides a clean view of the heart without suffering such severe issues. However, due to its significantly higher cost, it is often only afforded by a few major hospitals, hence hindering its use and accessibility. In this pilot study, we propose a novel approach to transform echocardiography into the cardiac MRI view. For this purpose, Echo2MRI dataset, consisting of echocardiography and real cardiac MRI image pairs, is composed and will be shared publicly. A dedicated Cycle-consistent Generative Adversarial Network (Cycle-GAN) is trained to learn the transformation from echocardiography frames to cardiac MRI views. An extensive set of qualitative evaluations shows that the proposed transformer can synthesize high-quality artifact-free synthetic cardiac MRI views from a given sequence of echocardiography frames. Medical evaluations performed by a group of cardiologists further demonstrate that synthetic MRI views are indistinguishable from their original counterparts and are preferred over their initial sequence of echocardiography frames for diagnosis in 78.9% of the cases.

超声心动图图像生成医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。