arXiv:2503.06827eess.IVcs.CV2025-03被引 16

用两阶段自引导噪声注意力,提升多模态医学图像去噪效果

Two-stage Deep Denoising with Self-guided Noise Attention for Multimodal Medical Images

  • 分两阶段去噪:先估计残差噪声,再通过自引导注意力融合信息
  • 在多个医学图像数据集上,PSNR提升7.64,SSIM提升0.1021,性能领先
  • 适用于多种成像模态和噪声类型,适合临床图像质量提升场景

医学图像去噪是极具挑战性的视觉任务。尽管具有实际应用价值,现有方法在处理异质医学图像时常产生视觉伪影。本文提出一种基于人工智能的两阶段学习策略,先从含噪图像中估计残差噪声,再引入新颖的噪声注意力机制,将估计的噪声与原始输入关联,实现由粗到精的去噪过程。同时,采用多模态学习策略,使模型在不同医学图像模态及多种噪声模式下具备良好泛化能力。通过大量实验验证,所提方法在定量与定性对比中均达到当前最优性能:在峰值信噪比(PSNR)上提升7.64,在结构相似性指数(SSIM)上提升0.1021,在ΔE上提升0.80,在像素级视觉信息保真度(VIFP)上提升0.1855,在均方误差(MSE)上降低18.54。

原文摘要 · Abstract (English)

Medical image denoising is considered among the most challenging vision tasks. Despite the real-world implications, existing denoising methods have notable drawbacks as they often generate visual artifacts when applied to heterogeneous medical images. This study addresses the limitation of the contemporary denoising methods with an artificial intelligence (AI)-driven two-stage learning strategy. The proposed method learns to estimate the residual noise from the noisy images. Later, it incorporates a novel noise attention mechanism to correlate estimated residual noise with noisy inputs to perform denoising in a course-to-refine manner. This study also proposes to leverage a multi-modal learning strategy to generalize the denoising among medical image modalities and multiple noise patterns for widespread applications. The practicability of the proposed method has been evaluated with dense experiments. The experimental results demonstrated that the proposed method achieved state-of-the-art performance by significantly outperforming the existing medical image denoising methods in quantitative and qualitative comparisons. Overall, it illustrates a performance gain of 7.64 in Peak Signal-to-Noise Ratio (PSNR), 0.1021 in Structural Similarity Index (SSIM), 0.80 in DeltaE ($ΔE$), 0.1855 in Visual Information Fidelity Pixel-wise (VIFP), and 18.54 in Mean Squared Error (MSE) metrics.

医学图像去噪多模态注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。