arXiv:2511.15771eess.IVcs.CV2025-11被引 7

轻量适配超声图像分割,仅用9%参数实现高性能临床部署。

UniUltra: Interactive Parameter-Efficient SAM2 for Universal Ultrasound Segmentation

  • 提出上下文-边缘混合适配器,高效提升多模态超声感知能力。
  • 压缩后模型参数减少94.08%,仍保持与原版SAM2相当的精度。
  • 适合资源受限的临床场景,支持快速部署与实时推理。

Segment Anything Model 2 (SAM2) 在自然图像上表现出卓越的通用分割能力,但在超声图像上因域差异导致性能显著下降。为此,我们提出 UniUltra 实现通用超声分割。首先引入新颖的上下文-边缘混合适配器(CH-Adapter),在保持参数效率的同时增强对多种超声成像模式的细粒度感知能力。为提升临床实用性,进一步设计深度监督知识蒸馏(DSKD)技术,将微调后 SAM2 的大图像编码器知识迁移到超轻量编码器,大幅降低计算开销。实验表明,UniUltra 在多个数据集上超越现有方法,具备更强泛化能力。微调阶段仅使用 8.91% 的 SAM2 参数,最终压缩模型相比原始 SAM2 参数量减少 94.08%,非常适合实际临床部署。代码已开源。

原文摘要 · Abstract (English)

The Segment Anything Model 2 (SAM2) demonstrates remarkable universal segmentation capabilities on natural images. However, its performance on ultrasound images is significantly degraded due to domain disparities. This limitation raises two critical challenges: how to efficiently adapt SAM2 to ultrasound imaging while maintaining parameter efficiency, and how to deploy the adapted model effectively in resource-constrained clinical environments. To address these issues, we propose UniUltra for universal ultrasound segmentation. Specifically, we first introduce a novel context-edge hybrid adapter (CH-Adapter) that enhances fine-grained perception across diverse ultrasound imaging modalities while achieving parameter-efficient fine-tuning. To further improve clinical applicability, we develop a deep-supervised knowledge distillation (DSKD) technique that transfers knowledge from the large image encoder of the fine-tuned SAM2 to a super lightweight encoder, substantially reducing computational requirements without compromising performance. Extensive experiments demonstrate that UniUltra outperforms state-of-the-arts with superior generalization capabilities. Notably, our framework achieves competitive performance using only 8.91% of SAM2's parameters during fine-tuning, and the final compressed model reduces the parameter count by 94.08% compared to the original SAM2, making it highly suitable for practical clinical deployment. The source code is available at https://github.com/xq141839/UniUltra.

超声分割参数高效知识蒸馏轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。