用大模型指导小模型,精准分割肠道息肉边界。
Sharpening Lightweight Models for Generalized Polyp Segmentation: A Boundary Guided Distillation from Foundation Models

- 从大模型中蒸馏语义与边界信息,分路学习提升精度。
- 在多个数据集上超越轻量级基线,达到顶尖水平。
- 适合临床实时应用,兼顾性能与计算效率。
自动息肉分割对早期结直肠癌检测至关重要,但受限于边界模糊、外观差异大及标注数据少。轻量级模型如U-Net、U-Net++和PraNet虽适合临床部署,却难以捕捉复杂息肉区域的丰富语义与结构特征。而大视觉基础模型(VFMs)如SAM、OneFormer、Mask2Former和DINOv2虽具强泛化能力,却因领域不匹配、边界敏感度不足及高计算成本,在息肉分割上迁移效果差。为此,我们提出LiteBounD框架,通过多VFMs向紧凑编码器蒸馏互补的语义与结构先验。其核心包括:(i) 双路径蒸馏机制分离语义与边界感知表征;(ii) 频率感知对齐策略分别监督低频全局语义与高频边界细节;(iii) 边界感知解码器融合多尺度特征与蒸馏后的丰富边界信息以实现精确分割。在已见(Kvasir-SEG、CVC-ClinicDB)与未见(ColonDB、CVC-300、ETIS)数据集上的实验表明,LiteBounD显著优于各轻量级基线,性能媲美当前最优方法,且满足实时临床应用所需的高效性。代码已开源。
原文摘要 · Abstract (English)
Automated polyp segmentation is critical for early colorectal cancer detection and its prevention, yet remains challenging due to weak boundaries, large appearance variations, and limited annotated data. Lightweight segmentation models such as U-Net, U-Net++, and PraNet offer practical efficiency for clinical deployment but struggle to capture the rich semantic and structural cues required for accurate delineation of complex polyp regions. In contrast, large Vision Foundation Models (VFMs), including SAM, OneFormer, Mask2Former, and DINOv2, exhibit strong generalization but transfer poorly to polyp segmentation due to domain mismatch, insufficient boundary sensitivity, and high computational cost. To bridge this gap, we propose \textit{\textbf{LiteBounD}, a \underline{Li}gh\underline{t}w\underline{e}ight \underline{Boun}dary-guided \underline{D}istillation} framework that transfers complementary semantic and structural priors from multiple VFMs into compact segmentation backbones. LiteBounD introduces (i) a dual-path distillation mechanism that disentangles semantic and boundary-aware representations, (ii) a frequency-aware alignment strategy that supervises low-frequency global semantics and high-frequency boundary details separately, and (iii) a boundary-aware decoder that fuses multi-scale encoder features with distilled semantically rich boundary information for precise segmentation. Extensive experiments on both seen (Kvasir-SEG, CVC-ClinicDB) and unseen (ColonDB, CVC-300, ETIS) datasets demonstrate that LiteBounD consistently outperforms its lightweight baselines by a significant margin and achieves performance competitive with state-of-the-art methods, while maintaining the efficiency required for real-time clinical use. Our code is available at https://github.com/lostinrepo/LiteBounD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。