轻量级3D医学分割模型通过降维引导提升精度与效率。
Johnson-Lindenstrauss Lemma Guided Network for Efficient 3D Medical Segmentation
- 用约当-林登斯特拉引理指导卷积,实现低参数高鲁棒特征提取。
- 在多模态数据上提升26%的Dice分数,推理速度提升48倍。
- 适合资源受限场景下的医学图像分割任务,尤其关注高效部署。
轻量级3D医学图像分割面临效率与鲁棒性之间的根本矛盾,尤其在处理复杂解剖结构和异质模态时。本文提出VeloxSeg,一种可部署且可扩展的双流CNN-Transformer架构,包含配对窗口注意力(PWA)和约当-林登斯特拉引理引导卷积(JLC)。针对每张3D图像,采用“快速扫描-聚焦”策略:PWA快速获取多尺度信息,JLC以极少参数实现稳健局部特征提取,显著提升低计算预算下的性能。进一步扩展双流结构,将模态交互融入多尺度图像检索过程,有效建模异质模态。最后,通过格拉姆矩阵实现空间解耦知识迁移(SDKT),将自监督网络提取的纹理先验注入分割网络,提升表示能力且无额外推理开销。在多模态基准测试中,VeloxSeg实现26%的Dice分数提升,GPU吞吐量提升11倍,CPU提升48倍,训练峰值GPU内存减少至1/20,推理内存减少至1/24。代码已开源。
原文摘要 · Abstract (English)
Lightweight 3D medical image segmentation remains constrained by a fundamental \textit{``efficiency / robustness conflict''}, particularly when processing complex anatomical structures and heterogeneous modalities. In this paper, we study how to redesign the framework based on the characteristics of high-dimensional 3D images, and explore data synergy to overcome the fragile representation of lightweight methods. Our approach, VeloxSeg, begins with a deployable and extensible dual-stream CNN-Transformer architecture composed of Paired Window Attention (PWA) and Johnson-Lindenstrauss lemma-guided convolution (JLC). For each 3D image, we invoke a ``glance-and-focus'' principle, where PWA rapidly retrieves multi-scale information, and JLC ensures robust local feature extraction with minimal parameters, significantly enhancing the model's ability to operate with low computational budget. Followed by an extension of the dual-stream architecture that incorporates modal interaction into the multi-scale image-retrieval process, VeloxSeg efficiently models heterogeneous modalities. Finally, Spatially Decoupled Knowledge Transfer (SDKT) via Gram matrices injects the texture prior extracted by a self-supervised network into the segmentation network, yielding stronger representations than baselines at no extra inference cost. Experimental results on multimodal benchmarks show that VeloxSeg achieves a 26\% Dice improvement, alongside increasing GPU throughput by 11$\times$, CPU by 48$\times$, and reducing training peak GPU memory usage by $1/20$, inference by $1/24$. Code is available at https://github.com/JinPLu/VeloxSeg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。