arXiv:2411.05885eess.IVcs.CV2024-11中稿 · publication at the…被引 5

提出两种新方法提升低质量医学图像清晰度,不依赖标注数据。

Alternative Learning Paradigms for Image Quality Transfer

  • 用无监督稀疏表示和深度字典学习重构图像
  • 在低场MRI上优于现有监督方法,尤其处理分布外数据时
  • 适合缺乏标注数据的医疗成像场景

图像质量迁移(IQT)旨在通过从高质量图像中学习丰富信息,增强低质量医学图像的对比度与分辨率,例如来自低功耗设备的图像。不同于现有基于监督学习的方法,本文提出两种新型IQT问题形式:第一种为无监督学习框架,基于稀疏表示(SRep)与字典学习,称为IQT-SRep;第二种结合监督与无监督学习,基于深度字典学习(DDL),称为IQT-DDL。IQT-SRep利用低质量和高质量图像对训练两个字典,通过低质量字典的稀疏表示直接恢复对应高质量块。IQT-DDL则显式学习高分辨率字典以放大输入图像,同时联合优化网络与字典生成器,充分运用深度学习能力。在低场磁共振成像(MRI)任务中评估,目标是恢复接近高场扫描器获得的高质量图像。实验表明,相比最先进的监督学习方法(IQT-DL),这两种新范式在分布外数据测试中避免了监督方法的偏差,展现出在真实场景中的潜力。

原文摘要 · Abstract (English)

Image Quality Transfer (IQT) aims to enhance the contrast and resolution of low-quality medical images, e.g. obtained from low-power devices, with rich information learned from higher quality images. In contrast to existing IQT methods which adopt supervised learning frameworks, in this work, we propose two novel formulations of the IQT problem. The first approach uses an unsupervised learning framework, whereas the second is a combination of both supervised and unsupervised learning. The unsupervised learning approach considers a sparse representation (SRep) and dictionary learning model, which we call IQT-SRep, whereas the combination of supervised and unsupervised learning approach is based on deep dictionary learning (DDL), which we call IQT-DDL. The IQT-SRep approach trains two dictionaries using a SRep model using pairs of low- and high-quality volumes. Subsequently, the SRep of a low-quality block, in terms of the low-quality dictionary, can be directly used to recover the corresponding high-quality block using the high-quality dictionary. On the other hand, the IQT-DDL approach explicitly learns a high-resolution dictionary to upscale the input volume, while the entire network, including high dictionary generator, is simultaneously optimised to take full advantage of deep learning methods. The two models are evaluated using a low-field magnetic resonance imaging (MRI) application aiming to recover high-quality images akin to those obtained from high-field scanners. Experiments comparing the proposed approaches against state-of-the-art supervised deep learning IQT method (IQT-DL) identify that the two novel formulations of the IQT problem can avoid bias associated with supervised methods when tested using out-of-distribution data that differs from the distribution of the data the model was trained on. This highlights the potential benefit of these novel paradigms for IQT.

图像增强无监督学习医学影像字典学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。