用未训练网络的感知损失提升MRI中线条结构去噪效果
Untrained Perceptual Loss for image denoising of line-like structures in MR images
- 用未训练网络特征图构建3D感知损失,捕捉线条结构上下文
- 在四种瑞利噪声下,优于L1和SSIM损失,5层网络性能最佳
- 小模型如VGG表现不输大模型,适合医学与生物成像去噪
磁共振(MR)图像采集时间缩短会导致噪声增加,因此利用深度学习自动去噪具有重要意义。含线条结构(如脑血管、植物根系)的MR图像具有连通性与稀疏性特征,去噪时需考虑体素邻域信息。本文将感知损失扩展至3D数据,通过比较未训练网络的特征图构建损失函数,测试其在脑血管成像(MRA)和土壤中植物根系图像上的去噪性能。研究了权重初始化、网络深度、卷积核大小和池化操作对结果的影响。在四种瑞利噪声水平下,采用结构相似性指数(SSIM)等指标评估,发现未训练感知损失(uPL)优于传统的L1损失或基于SSIM的损失。网络初始化不影响结果,但深度和池化方式显著影响性能;例如,5层卷积网络表现最优,更深网络性能下降。小型uPL网络(如简化VGG)表现优于或等同于大型网络。在所有噪声水平和三种网络架构下,uPL均表现更优。结论:对于含线条结构的图像,uPL是3D去噪的有效替代损失函数。
原文摘要 · Abstract (English)
In the acquisition of Magnetic Resonance (MR) images shorter scan times lead to higher image noise. Therefore, automatic image denoising using deep learning methods is of high interest. MR images containing line-like structures such as roots or vessels yield special characteristics as they display connected structures and yield sparse information. For this kind of data, it is important to consider voxel neighborhoods when training a denoising network. In this paper, we translate the Perceptual Loss to 3D data by comparing feature maps of untrained networks in the loss function as done previously for 2D data. We tested the performance of untrained Perceptual Loss (uPL) on 3D image denoising of MR images displaying brain vessels (MR angiograms - MRA) and images of plant roots in soil. We investigate the impact of various uPL characteristics such as weight initialization, network depth, kernel size, and pooling operations on the results. We tested the performance of the uPL loss on four Rician noise levels using evaluation metrics such as the Structural Similarity Index Metric (SSIM). We observe, that our uPL outperforms conventional loss functions such as the L1 loss or a loss based on the Structural Similarity Index Metric (SSIM). The uPL network's initialization is not important, while network depth and pooling operations impact denoising performance. E.g. for both datasets a network with five convolutional layers led to the best performance while a network with more layers led to a performance drop. We also find that small uPL networks led to better or comparable results than using large networks such as VGG. We observe superior performance of our loss for both datasets, all noise levels, and three network architectures. In conclusion, for images containing line-like structures, uPL is an alternative to other loss functions for 3D image denoising.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。