轻量级脑肿瘤分割框架,用不确定性引导知识蒸馏提升精度。
Uni-Light: An Ultra-Lightweight Framework via Uncertainty-Aware Knowledge Distillation for Brain Tumour Segmentation

- 通过不确定感知的知识蒸馏,让小模型聚焦难分区域。
- 参数减少97.56%,计算量降73.03%,Dice分数仍超顶尖模型1.47%。
- 无需额外标注,利用教师模型不确定性重构训练数据分布。
从多模态磁共振成像(MRI)中准确分割3D脑肿瘤对临床诊断与治疗规划至关重要。现有方法计算开销大,而轻量架构常在复杂肿瘤区域丢失精度。为此,我们提出新型超轻量框架Uni-Light,结合多尺度卷积与不确定感知知识蒸馏,引导学生模型关注难分类区域,并引入符号距离场边界损失提供几何约束。在BraTS2023-GLI与MSD-BTS数据集上的实验表明,Uni-Light参数减少97.56%,浮点运算量(FLOPs)降低73.03%,推理内存占用下降81.58%,平均Dice分数比当前最优模型高1.47%,在资源受限的临床场景中实现了精度与效率的优异平衡。本工作还推进医学影像数据工程,证明可利用教师模型不确定性作为数据驱动监督信号,无需额外标注即可重校训练数据分布。
原文摘要 · Abstract (English)
Accurate 3D brain tumour segmentation from multi-modal Magnetic Resonance Imaging (MRI) is essential for clinical diagnosis and treatment planning. Existing brain tumour segmentation methods often suffer from heavy computational demands, while current lightweight architectures frequently lack the capacity to maintain segmentation fidelity in complex tumour regions. To address these issues, we propose a novel ultra-lightweight framework (Uni-Light) that achieves high-fidelity segmentation with substantially reduced computational overhead. It combines multi-scale convolutions with an uncertainty-aware knowledge distillation scheme that directs the student model toward hard-to-classify regions, complemented by a Signed Distance Field boundary loss for geometric constraints. Experimental results on BraTS2023-GLI and MSD-BTS datasets demonstrate that Uni-Light reduces parameters by 97.56%, floating-point operations (FLOPs) by 73.03%, and inference memory footprint by 81.58%, while surpassing the state-of-the-art model by an average of 1.47% in Dice score, offering a highly competitive trade-off between segmentation accuracy and computational efficiency in resource-constrained clinical settings. This work also advances data engineering for medical imaging by demonstrating that teacher model uncertainty can be exploited as a data-driven supervisory signal, re-prioritising the training data distribution without requiring additional annotation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。