arXiv:2606.00928cs.CVcs.LG2026-06

用多通道模型教单通道模型分割组织,性能接近原模型。

Single-Channel Tissue Segmentation via Cross-Modal Distillation from Foundation Models

论文配图:Single-Channel Tissue Segmentation via Cross-Modal Distillation from Foundation Models
图 1 · 摘自论文原文
  • 用多通道大模型作为教师,指导仅用核染色图像的轻量学生模型。
  • 在TissueNet上,学生模型达78.36的Dice分数,提升13点以上。
  • 无需重新训练教师,跨数据集仍有效,适合资源受限场景。

多重荧光显微镜通过核(DAPI)和膜(E-cadherin)等互补通道提供更丰富的空间信息,优于单一通道成像。但多通道模型需所有通道输入,限制了部分通道缺失时的应用。本文提出一种跨模态知识蒸馏框架,将冻结的多通道基础模型(教师)的语义信息迁移到仅依赖核通道的轻量学生模型。蒸馏目标结合均方误差概率匹配、边界感知监督和可学习不确定性加权。评估中使用SAM ViT-H与CellSAM作为教师,四种U-Net学生模型(Swin-Tiny 27M、ResNet18 11M、EfficientNet-B0 5.3M、MobileNetV3 1.5M)在TissueNet与BBBC038数据集上表现。在TissueNet上,经SAM蒸馏的Swin-Tiny学生模型获得78.36(±1.44)的Dice分数,相比无蒸馏基线(65.31±1.35)提升13.05点,达到教师最优性能(89.12±1.21)的87.9%,参数量减少23倍。四种学生模型均提升约12个Dice点,验证了架构无关性。在跨数据集的BBBC038上亦取得一致增益,无需重训教师。

原文摘要 · Abstract (English)

Multiplexed fluorescence microscopy improves tissue segmentation by providing complementary channels including nuclear (DAPI) and membrane (E-cadherin), that together encode richer spatial context than single-channel imaging alone. However, multiplexed models require all channels at inference, limiting deployment where only a subset is available. This work proposes a cross-modal knowledge distillation framework that transfers semantic information from a frozen foundation model teacher processing multiplexed input to a lightweight student operating on the nuclear channel only. The distillation objective combines MSE-based probability matching, boundary-aware supervision, and learnable uncertainty weighting. SAM ViT-H and CellSAM are evaluated as teachers across four U-Net students: Swin-Tiny (27M), ResNet18 (11M), EfficientNet-B0 (5.3M), and MobileNetV3 (1.5M), on TissueNet and BBBC038. On TissueNet, the SAM-distilled Swin-Tiny student achieves Dice 78.36 (plus or minus 1.44), a 13.05-point improvement over the no-KD baseline (65.31 plus or minus 1.35) and 87.9% recovery of teacher oracle performance (89.12 plus or minus 1.21) at a 23x parameter reduction. KD consistently improves all four students by approximately 12 Dice points, confirming architecture-agnostic distillation. SAM ViT-H outperforms CellSAM as teacher across all settings. Cross-dataset evaluation on BBBC038 shows consistent gains without teacher retraining.

医学图像知识蒸馏单通道分割轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。