轻量级医学图像修复模型,通过可靠病灶语义先验提升重建质量与效率。
Lightweight Medical Image Restoration via Integrating Reliable Lesion-Semantic Driven Prior
- 基于频域引导的交叉注意力机制,降低计算开销
- 利用蒙特卡洛采样生成可靠病灶语义先验,提升结果可信度
- 适用于低剂量CT、MRI超分辨等临床高要求场景
医学图像恢复旨在从退化图像中重建高质量影像,在低剂量CT去噪、MRI超分辨率和伪影去除等临床场景中需求迫切。现有深度学习方法虽有效,但计算复杂度高且忽视结果可靠性。为此,本文提出轻量级Transformer架构LRformer,采用频域可靠性引导学习。受贝叶斯神经网络不确定性量化启发,设计了可靠病灶语义先验生成器(RLPP),通过在基础分割模型MedSAM上多次随机推断,利用蒙特卡洛估计生成可靠先验。不直接在空间域融合先验,而是通过快速傅里叶变换(FFT)将交叉注意力分解为实对称与虚反对称部分,构建频域引导交叉注意力(GFCA)。该设计利用FFT共轭对称性,使计算复杂度近乎减半。多任务实验表明,LRformer在有效性与效率上均优于现有方法。
原文摘要 · Abstract (English)
Medical image restoration tasks aim to recover high-quality images from degraded observations, exhibiting emergent desires in many clinical scenarios, such as low-dose CT image denoising, MRI super-resolution, and MRI artifact removal. Despite the success achieved by existing deep learning-based restoration methods with sophisticated modules, they struggle with rendering computationally-efficient reconstruction results. Moreover, they usually ignore the reliability of the restoration results, which is much more urgent in medical systems. To alleviate these issues, we present LRformer, a Lightweight Transformer-based method via Reliability-guided learning in the frequency domain. Specifically, inspired by the uncertainty quantification in Bayesian neural networks (BNNs), we develop a Reliable Lesion-Semantic Prior Producer (RLPP). RLPP leverages Monte Carlo (MC) estimators with stochastic sampling operations to generate sufficiently-reliable priors by performing multiple inferences on the foundational medical image segmentation model, MedSAM. Additionally, instead of directly incorporating the priors in the spatial domain, we decompose the cross-attention (CA) mechanism into real symmetric and imaginary anti-symmetric parts via fast Fourier transform (FFT), resulting in the design of the Guided Frequency Cross-Attention (GFCA) solver. By leveraging the conjugated symmetric property of FFT, GFCA reduces the computational complexity of naive CA by nearly half. Extensive experimental results in various tasks demonstrate the superiority of the proposed LRformer in both effectiveness and efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。