用少量标注实现超声图像骨骼精准分割,适合医疗数据少的场景。
FlexICL: A Flexible Visual In-context Learning Framework for Elbow and Wrist Ultrasound Segmentation
- 基于上下文学习,仅需5%标注帧即可完成分割。
- 在4个数据集上比现有模型高1-27%的骰子系数。
- 适合标注成本高的医学影像场景,如儿童肘腕超声。
儿童肘腕骨折是最常见的骨折类型。超声中骨骼结构的自动分割可提升诊断准确性和治疗规划效率。骨折表现为骨皮质缺损,需专家判读。深度学习可提供实时反馈并突出关键结构,帮助训练不足的用户更自信地操作。然而,像素级专家标注耗时且昂贵。为此,我们提出FlexICL,一种新型灵活的视觉上下文学习框架,用于超声图像中骨性区域的分割。该方法适用于视频内分割场景:专家仅标注少量帧,模型对未见帧进行分割。我们系统研究了多种图像拼接技术与训练策略,并引入新型拼接方法,在少量标注下显著提升性能。通过融合多种增强策略,FlexICL在四个腕部和肘部超声数据集上表现稳健,仅需5%训练图像,即在1,252次超声扫描中,相比Painter、MAE-VQGAN等先进视觉ICL模型及U-Net、TransUNet等传统分割模型,平均提高1-27%的骰子系数。初步结果表明,FlexICL是解决标注稀缺条件下超声图像分割的高效可扩展方案。
原文摘要 · Abstract (English)
Elbow and wrist fractures are the most common fractures in pediatric populations. Automatic segmentation of musculoskeletal structures in ultrasound (US) can improve diagnostic accuracy and treatment planning. Fractures appear as cortical defects but require expert interpretation. Deep learning (DL) can provide real-time feedback and highlight key structures, helping lightly trained users perform exams more confidently. However, pixel-wise expert annotations for training remain time-consuming and costly. To address this challenge, we propose FlexICL, a novel and flexible in-context learning (ICL) framework for segmenting bony regions in US images. We apply it to an intra-video segmentation setting, where experts annotate only a small subset of frames, and the model segments unseen frames. We systematically investigate various image concatenation techniques and training strategies for visual ICL and introduce novel concatenation methods that significantly enhance model performance with limited labeled data. By integrating multiple augmentation strategies, FlexICL achieves robust segmentation performance across four wrist and elbow US datasets while requiring only 5% of the training images. It outperforms state-of-the-art visual ICL models like Painter, MAE-VQGAN, and conventional segmentation models like U-Net and TransUNet by 1-27% Dice coefficient on 1,252 US sweeps. These initial results highlight the potential of FlexICL as an efficient and scalable solution for US image segmentation well suited for medical imaging use cases where labeled data is scarce.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。