MedCore让医学分割模型瘦身60%仍保边界精度,适合临床部署。
MedCore: Boundary-Preserving Medical Core Pruning for MedSAM

- 基于双重干预与边界感知的结构化剪枝,保留关键特征。
- 参数减少60%,FLOPs降58.4%,边界F1达0.6388,HD95仅5.14。
- 揭示头部剪枝对边界破坏更敏感,指导高效压缩策略。
医疗分割基础模型如SAM和MedSAM虽具备强提示驱动分割能力,但其图像编码器在临床场景中仍过大。压缩风险在于模型可能维持高Dice值却丧失边界保真度。本文提出MedCore,一种针对MedSAM的结构化剪枝框架。核心思路是保留两类结构:在从SAM迁移到MedSAM过程中变得重要的结构,以及具有高边界杠杆性的结构。第一类通过双干预评分识别,对比零值与重置为原始SAM权重的效果;第二类通过边界感知的Fisher估计识别。此外,提出边界杠杆原理,表明压缩引起的边界偏移由边界处逻辑值扰动除以逻辑值空间梯度决定。该原理解释了为何边界指标可下降而Dice保持高位。在息肉分割基准测试中,MedCore实现60.0%参数缩减、58.4% FLOPs降低,恢复微调后取得Dice 0.9549、Boundary F1 0.6388、HD95 5.14。在86.6%参数压缩和90.4G FLOPs下仍保持良好边界质量。分析进一步表明,MedSAM处于头部脆弱边界区域:头部剪枝步骤的95百分位边界杠杆是MLP剪枝步骤的2.887倍,该逻辑层级效应与BF1和HD95退化一致。代码已开源:https://github.com/cenweizhang/MedCore。
原文摘要 · Abstract (English)
Medical segmentation foundation models such as SAM and MedSAM provide strong prompt-driven segmentation, but their image encoders are still too large for many clinical settings. Compression is also risky in medicine because a model can keep high Dice while losing boundary fidelity. We propose MedCore, a structured pruning framework for MedSAM. The main idea is to preserve two kinds of structures: structures that became important during SAM-to-MedSAM adaptation, and structures that have high boundary leverage. We identify the first type by a dual-intervention score that compares zeroing a group with resetting it to its original SAM weight. We identify the second type by boundary-aware Fisher estimation. We also introduce a boundary leverage principle, which shows that compression-induced boundary displacement is controlled by logit perturbation on the boundary divided by the logit spatial gradient. This principle explains why boundary metrics can degrade even when Dice remains high. On polyp segmentation benchmarks, MedCore reduces parameters by 60.0% and FLOPs by 58.4% while achieving Dice 0.9549, Boundary F1 0.6388, and HD95 5.14 after recovery fine-tuning. It also reaches 86.6% parameter reduction and 90.4G FLOPs with strong boundary quality. Our analysis further shows that MedSAM lies in a head-fragile boundary regime: head-pruning steps have 2.887 times larger 95th-percentile boundary leverage than MLP-pruning steps, and this logit-level effect is consistent with BF1 and HD95 degradation. Our code is available at https://github.com/cenweizhang/MedCore.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。