轻量化模型GPT-SAM高效精准分割脑肿瘤,支持多类型病灶。
GBT-SAM: A Parameter-Efficient Depth-Aware Model for Generalizable Brain tumour Segmentation on mp-MRI
- 基于SAM改进,仅用不到2.6%切片+全模态数据降低计算量
- 参数仅650万,Dice达93.54,在多种胶质瘤数据集表现稳定
- 适合临床部署的低资源、跨类型脑肿瘤分割场景
胶质瘤是需精准影像诊断的恶性脑肿瘤,分割对评估形态和制定治疗方案至关重要。手动勾画耗时且易变,促使深度学习提升一致性并减轻临床负担。然而现有方法未能充分挖掘多参数MRI(mp-MRI)中的跨切片上下文信息,通常需大量计算资源,且在不同肿瘤类型间泛化能力差。我们提出GBT-SAM,一种参数高效的深度学习框架,将大规模视觉模型Segment Anything Model(SAM)适配至体素级mp-MRI数据。该模型通过仅选取每例扫描少于2.6%的切片,同时保留全部四类MRI模态,显著降低输入复杂度并保留关键肿瘤信息。此外,采用两阶段微调策略,引入深度感知模块捕捉跨切片相关性,并设计轻量适配层,使可训练参数仅为650万,为当前基于SAM方法中最低。GBT-SAM在BraTS成人胶质瘤数据集上取得93.54的Dice分数,并在脑膜瘤、儿童胶质瘤及撒哈拉以南地区胶质瘤数据集上均展现稳健性能。结果表明,GBT-SAM是一种计算高效、领域鲁棒的mp-MRI脑肿瘤分割框架。代码与模型见https://github.com/vpulab/med-sam-brain。
原文摘要 · Abstract (English)
Gliomas are aggressive brain tumors that require accurate imaging-based diagnosis, with segmentation playing a critical role in evaluating morphology and treatment decisions. Manual delineation of gliomas is time-consuming and prone to variability, motivating the use of deep learning to improve consistency and alleviate clinical workload. However, existing methods often fail to fully exploit the information available in multi-parametric MRI (mp-MRI), particularly inter-slice contextual features, and typically require considerable computational resources while lacking robustness across tumor type variations. We present GBT-SAM, a parameter-efficient deep learning framework that adapts the Segment Anything Model (SAM), a large-scale vision model, to volumetric mp-MRI data. GBT-SAM reduces input complexity by selecting fewer than 2.6\% of slices per scan while incorporating all four MRI modalities, preserving essential tumor-related information with minimal cost. Furthermore, our model is trained by a two-step fine-tuning strategy that incorporates a depth-aware module to capture inter-slice correlations and lightweight adaptation layers, resulting in just 6.5M trainable parameters, which is the lowest among SAM-based approaches. GBT-SAM achieves a Dice Score of 93.54 on the BraTS Adult Glioma dataset and demonstrates robust performance on Meningioma, Pediatric Glioma, and Sub-Saharan Glioma datasets. These results highlight GBT-SAM's potential as a computationally efficient and domain-robust framework for brain tumor segmentation using mp-MRI. Our code and models are available at https://github.com/vpulab/med-sam-brain .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。