用稀疏令牌压缩提升3D医学图像分割效率,兼顾精度与速度。
TokenSeg: Efficient 3D Medical Image Segmentation via Hierarchical Visual Token Compression
- 分层编码器提取400个候选令牌,捕捉全局结构与边界细节。
- 边界感知令牌化选100个关键令牌,超60%位于肿瘤边缘。
- 稀疏解码重建高分辨率掩码,显著降低内存与推理延迟。
三维医学图像分割因体素计算量立方增长及同质区域冗余计算而计算密集。为解决此问题,我们提出TokenSeg,一种面向高效三维医学体积分割的边界感知稀疏令牌表示框架。具体而言:(1) 设计多尺度分层编码器,在四个分辨率层级提取400个候选令牌,以捕捉全局解剖上下文与精细边界细节;(2) 引入边界感知令牌化方法,结合VQ-VAE量化与重要性评分,选出100个显著令牌,其中超过60%位于肿瘤边界附近;(3) 开发稀疏到稠密解码器,通过令牌重投影、渐进上采样与跳跃连接重建全分辨率掩码。在包含960例的3D乳腺DCE-MRI数据集上的大量实验表明,TokenSeg在达到94.49% Dice和89.61% IoU的顶尖性能的同时,将GPU内存占用和推理延迟分别降低64%和68%。在MSD心脏和脑MRI基准数据集上的评估进一步验证其在异构解剖结构上的泛化能力,持续表现最优。结果表明,基于解剖信息的稀疏表示在精准高效分割中具有显著有效性。
原文摘要 · Abstract (English)
Three-dimensional medical image segmentation is a fundamental yet computationally demanding task due to the cubic growth of voxel processing and the redundant computation on homogeneous regions. To address these limitations, we propose \textbf{TokenSeg}, a boundary-aware sparse token representation framework for efficient 3D medical volume segmentation. Specifically, (1) we design a \emph{multi-scale hierarchical encoder} that extracts 400 candidate tokens across four resolution levels to capture both global anatomical context and fine boundary details; (2) we introduce a \emph{boundary-aware tokenizer} that combines VQ-VAE quantization with importance scoring to select 100 salient tokens, over 60\% of which lie near tumor boundaries; and (3) we develop a \emph{sparse-to-dense decoder} that reconstructs full-resolution masks through token reprojection, progressive upsampling, and skip connections. Extensive experiments on a 3D breast DCE-MRI dataset comprising 960 cases demonstrate that TokenSeg achieves state-of-the-art performance with 94.49\% Dice and 89.61\% IoU, while reducing GPU memory and inference latency by 64\% and 68\%, respectively. To verify the generalization capability, our evaluations on MSD cardiac and brain MRI benchmark datasets demonstrate that TokenSeg consistently delivers optimal performance across heterogeneous anatomical structures. These results highlight the effectiveness of anatomically informed sparse representation for accurate and efficient 3D medical image segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。