arXiv:2505.04105eess.IVcs.CV2025-05

用运动感知生成技术修复医学影像运动伪影,提升细节保真度。

MAISY: Motion-Aware Image SYnthesis for Medical Image Motion Correction

  • 基于SAM动态识别解剖边界处的运动模式,定位关键伪影区域。
  • 引入可变性选择的SSIM损失,增强高方差区域的细节保留能力。
  • 在胸部和头部CT上性能超越现有方法,指标提升显著,适合临床影像修复。

患者在医学成像过程中移动会导致图像模糊、伪影及器官变形,增加诊断难度。现有基于GAN的方法虽能通过结构相似性指数(SSIM)损失学习退化图像与真实图像间的映射,有效生成无运动伪影图像,但仍存在两大局限:(i) 主要关注全局结构特征,忽略常含病理信息的局部特征;(ii) SSIM损失对像素强度、亮度和方差变化敏感,难以处理复杂光照条件。本文提出运动感知图像合成模型MAISY,通过两步实现精准修正:(a) 利用基础模型Segment Anything Model(SAM)动态学习解剖边界处的时空模式,定位运动伪影高发区域;(b) 提出方差选择性SSIM(VS-SSIM)损失,自适应增强高像素方差区域的权重,以保护关键解剖细节。在胸部和头部CT数据集上的实验表明,相比当前最优方法,本模型使峰值信噪比(PSNR)提升40%,结构相似性(SSIM)提高10%,骰子系数(Dice)提升16%。

原文摘要 · Abstract (English)

Patient motion during medical image acquisition causes blurring, ghosting, and distorts organs, which makes image interpretation challenging. Current state-of-the-art algorithms using Generative Adversarial Network (GAN)-based methods with their ability to learn the mappings between corrupted images and their ground truth via Structural Similarity Index Measure (SSIM) loss effectively generate motion-free images. However, we identified the following limitations: (i) they mainly focus on global structural characteristics and therefore overlook localized features that often carry critical pathological information, and (ii) the SSIM loss function struggles to handle images with varying pixel intensities, luminance factors, and variance. In this study, we propose Motion-Aware Image SYnthesis (MAISY) which initially characterize motion and then uses it for correction by: (a) leveraging the foundation model Segment Anything Model (SAM), to dynamically learn spatial patterns along anatomical boundaries where motion artifacts are most pronounced and, (b) introducing the Variance-Selective SSIM (VS-SSIM) loss which adaptively emphasizes spatial regions with high pixel variance to preserve essential anatomical details during artifact correction. Experiments on chest and head CT datasets demonstrate that our model outperformed the state-of-the-art counterparts, with Peak Signal-to-Noise Ratio (PSNR) increasing by 40%, SSIM by 10%, and Dice by 16%.

医学影像运动校正生成模型图像修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。