提出自适应感受野卷积,提升医学图像分割精度
PARF-Net: integrating pixel-wise adaptive receptive fields into hybrid Transformer-CNN network for medical image segmentation
- 引入像素级自适应感受野卷积,动态调整每像素的感知范围
- 在Synapse数据集上达84.27%平均Dice,显著优于现有方法
- 适合需要精准分割病灶形状与尺度差异大的医学图像任务
卷积神经网络擅长局部特征提取,而Transformer在处理全局语义信息方面表现更优。通过融合两者优势,混合Transformer-CNN架构已成为医学图像分割的主要范式。然而,现有方法仍受限于卷积固定感受野,难以充分学习局部语义特征,且在有效整合局部与长程依赖关系方面表现不足。为此,本文提出PARF-Net,将像素级自适应感受野卷积(Conv-PARF)融入混合网络中。Conv-PARF可应对像素间语义差异,动态调整每个像素的卷积感受野,从而为不同形状和尺度的病灶提供区分性特征,实现病灶与背景的解耦。经过轻量化混合Transformer-CNN模块处理后,该特征能有效捕捉局部与长程依赖关系,显著提升分割性能。在MoNuSeg、GlaS、DSB2018和多器官Synapse四个常用医学图像数据集上的评估表明,PARF-Net优于当前主流方法。例如,在Synapse数据集上取得84.27%的平均Dice系数,大幅超越现有技术。
原文摘要 · Abstract (English)
Convolutional neural networks (CNNs) excel in local feature extraction while Transformers are superior in processing global semantic information. By leveraging the strengths of both, hybrid Transformer-CNN networks have become the major architectures in medical image segmentation tasks. However, existing hybrid methods still suffer deficient learning of local semantic features due to the fixed receptive fields of convolutions, and also fall short in effectively integrating local and long-range dependencies. To address these issues, we develop a new method PARF-Net to integrate convolutions of Pixel-wise Adaptive Receptive Fields (Conv-PARF) into hybrid Network for medical image segmentation. The Conv-PARF is introduced to cope with inter-pixel semantic differences and dynamically adjust convolutional receptive fields for each pixel, thus providing distinguishable features to disentangle the lesions with varying shapes and scales from the background. The features derived from the Conv-PARF layers are further processed using hybrid Transformer-CNN blocks under a lightweight manner, to effectively capture local and long-range dependencies, thus boosting the segmentation performance. By assessing PARF-Net on four widely used medical image datasets including MoNuSeg, GlaS, DSB2018 and multi-organ Synapse, we showcase the advantages of our method over the state-of-the-arts. For instance, PARF-Net achieves 84.27% mean Dice on the Synapse dataset, surpassing existing methods by a large margin.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。