arXiv:2410.15360eess.IVcs.CV2024-10被引 6

提出新模型提升3D医学图像边界分割精度,显著优于当前最佳方法。

Improving 3D Medical Image Segmentation at Boundary Regions using Local Self-attention and Global Volume Mixing

  • 结合局部自注意力与全局体积混合机制捕捉三维特征依赖
  • 在Synapse数据集上HD95指标提升3.82%,其他数据集也表现更优
  • 特别适合需要精确边界识别的医学分割任务,如细胞实例分割

体积分割是医学图像分析中的基础问题,目标是在体素级别准确分类3D医学图像。本文提出一种新型分层编码器-解码器框架,显式建模体数据的局部与全局依赖关系。该框架利用基于体块的局部自注意力捕获高分辨率下的局部依赖,并引入新颖的体积分量MLP-mixer,在低分辨率特征表示中捕捉全局依赖,从而学习更优的体素特征关联性。这些显式的局部与全局特征有助于更好建模器官形状边界的特性。在三个不同数据集上的大量实验表明,所提方法优于当前最先进方法:在具有挑战性的Synapse多器官数据集上,HD95指标绝对提升3.82%;类似提升模式也在MSD肝脏和胰腺肿瘤数据集中观察到。此外,我们还通过适配2D视觉领域近期架构设计选择,对3D医学图像分割进行了详尽比较。最后,在训练数据有限的ZebraFish 3D细胞膜数据集上,所提vMixer模型展现出优异的迁移学习能力,在关键的3D细胞实例分割任务中实现高精度边界预测。

原文摘要 · Abstract (English)

Volumetric medical image segmentation is a fundamental problem in medical image analysis where the objective is to accurately classify a given 3D volumetric medical image with voxel-level precision. In this work, we propose a novel hierarchical encoder-decoder-based framework that strives to explicitly capture the local and global dependencies for volumetric 3D medical image segmentation. The proposed framework exploits local volume-based self-attention to encode the local dependencies at high resolution and introduces a novel volumetric MLP-mixer to capture the global dependencies at low-resolution feature representations, respectively. The proposed volumetric MLP-mixer learns better associations among volumetric feature representations. These explicit local and global feature representations contribute to better learning of the shape-boundary characteristics of the organs. Extensive experiments on three different datasets reveal that the proposed method achieves favorable performance compared to state-of-the-art approaches. On the challenging Synapse Multi-organ dataset, the proposed method achieves an absolute 3.82\% gain over the state-of-the-art approaches in terms of HD95 evaluation metrics {while a similar improvement pattern is exhibited in MSD Liver and Pancreas tumor datasets}. We also provide a detailed comparison between recent architectural design choices in the 2D computer vision literature by adapting them for the problem of 3D medical image segmentation. Finally, our experiments on the ZebraFish 3D cell membrane dataset having limited training data demonstrate the superior transfer learning capabilities of the proposed vMixer model on the challenging 3D cell instance segmentation task, where accurate boundary prediction plays a vital role in distinguishing individual cell instances.

3D分割医学图像边界优化MLP-mixer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。