轻量级网络提升胰腺CT分割精度,兼顾多尺度与全局信息
DMC-Net: Lightweight Dynamic Multi-Scale and Multi-Resolution Convolution Network for Pancreas Segmentation in CT Images
- 设计动态多尺度/多分辨率卷积模块,自适应捕捉不同尺寸特征
- 在3个公开数据集上平均Dice达89.6%,优于主流模型
- 模块轻量可替换,适合医疗图像分割场景快速部署
卷积神经网络在医学图像分割中表现优异,但难以建模器官形状和大小的个体差异,且缺乏对全局长程上下文信息的利用能力,因其通常采用固定局部感受野的卷积且缺乏全局信息建模机制。为此,本文提出动态多分辨率卷积(DMRC)和动态多尺度卷积(DMSC)模块,增强单个卷积的表征能力,以捕获不同尺度特征和全局上下文信息。其中,DMRC模块在多分辨率图像上应用卷积,并通过动态机制建模特征间的全局依赖关系;而DMSC模块则通过不同核大小的卷积提取多尺度特征,并利用动态机制提取全局上下文信息。为降低大核卷积带来的计算负担,提出轻量级设计。二者均为轻量级即插即用模块,可嵌入通用CNN架构进行端到端训练。将二者集成至标准U-Net结构中,构建出动态多尺度与多分辨率卷积网络(DMC-Net)。实验表明,所提模块显著提升单个卷积的表征能力,有效提高分割精度。
原文摘要 · Abstract (English)
Convolutional neural networks (CNNs) have shown great effectiveness in medical image segmentation. However, they may be limited in modeling large inter-subject variations in organ shapes and sizes and exploiting global long-range contextual information. This is because CNNs typically employ convolutions with fixed-sized local receptive fields and lack the mechanisms to utilize global information. To address these limitations, we developed Dynamic Multi-Resolution Convolution (DMRC) and Dynamic Multi-Scale Convolution (DMSC) modules. Both modules enhance the representation capabilities of single convolutions to capture varying scaled features and global contextual information. This is achieved in the DMRC module by employing a convolutional filter on images with different resolutions and subsequently utilizing dynamic mechanisms to model global inter-dependencies between features. In contrast, the DMSC module extracts features at different scales by employing convolutions with different kernel sizes and utilizing dynamic mechanisms to extract global contextual information. The utilization of convolutions with different kernel sizes in the DMSC module may increase computational complexity. To lessen this burden, we propose to use a lightweight design for convolution layers with a large kernel size. Thus, DMSC and DMRC modules are designed as lightweight drop-in replacements for single convolutions, and they can be easily integrated into general CNN architectures for end-to-end training. The segmentation network was proposed by incorporating our DMSC and DMRC modules into a standard U-Net architecture, termed Dynamic Multi-scale and Multi-resolution Convolution network (DMC-Net). The results demonstrate that our proposed DMSC and DMRC can enhance the representation capabilities of single convolutions and improve segmentation accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。