轻量级3D医学图像分割模型,兼顾精度与速度。
GPAFormer: Graph-guided Patch Aggregation Transformer for Efficient 3D Medical Image Segmentation
- 用多尺度注意力聚合和图引导特征聚合提升小目标识别能力
- 参数仅181万,在多个数据集上分割准确率领先
- 单次推理耗时低于1秒,适合临床实时应用
深度学习已广泛应用于3D医学图像分割任务。然而,由于成像模态多样、数据维度高、解剖结构异质性强,实现多器官分割在精度与计算效率间的平衡仍是挑战。本文提出GPAFormer,一种专为3D医学图像分割设计的轻量级网络架构,强调效率同时保持高精度。其核心包含两个模块:多尺度注意力引导堆叠聚合(MASA)与互感知补丁图聚合器(MPGA)。MASA采用三路并行路径结合平面聚合,增强对不同尺度结构的处理能力;MPGA基于补丁间特征相似性与空间邻近性,动态聚合相似区域,提升器官内部及边界结构的区分度。在BTCV、Synapse、ACDC、BraTS等公开全身体部CT/MRI数据集上测试,仅使用1.81M参数,即在BTCV(75.70%)、Synapse(81.20%)、ACDC(89.32%)、BraTS(82.74%)上达到最高总体骰形系数(DSC)。在消费级GPU上,单个BTCV验证病例推理时间不足1秒。结果表明,GPAFormer在多器官、多模态3D分割任务中实现了精度与效率的平衡,尤其适用于资源受限与时间敏感的临床场景。
原文摘要 · Abstract (English)
Deep learning has been widely applied to 3D medical image segmentation tasks. However, due to the diversity of imaging modalities, the high-dimensional nature of the data, and the heterogeneity of anatomical structures, achieving both segmentation accuracy and computational efficiency in multi-organ segmentation remains a challenge. This study proposed GPAFormer, a lightweight network architecture specifically designed for 3D medical image segmentation, emphasizing efficiency while keeping high accuracy. GPAFormer incorporated two core modules: the multi-scale attention-guided stacked aggregation (MASA) and the mutual-aware patch graph aggregator (MPGA). MASA utilized three parallel paths with different receptive fields, combined through planar aggregation, to enhance the network's capability in handling structures of varying sizes. MPGA employed a graph-guided approach to dynamically aggregate regions with similar feature distributions based on inter-patch feature similarity and spatial adjacency, thereby improving the discrimination of both internal and boundary structures of organs. Experiments were performed on public whole-body CT and MRI datasets including BTCV, Synapse, ACDC, and BraTS. Compared to the existed 3D segmentation networkd, GPAFormer using only 1.81 M parameters achieved overall highest DSC on BTCV (75.70%), Synapse (81.20%), ACDC (89.32%), and BraTS (82.74%). Using consumer level GPU, the inference time for one validation case of BTCV spent less than one second. The results demonstrated that GPAFormer balanced accuracy and efficiency in multi-organ, multi-modality 3D segmentation tasks across various clinical scenarios especially for resource-constrained and time-sensitive clinical environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。