arXiv:2511.11510cs.CV2025-11被引 4

首个开源超声影像基础模型,用自适应掩码对比学习提升泛化能力

OpenUS: A Fully Open-Source Foundation Model for Ultrasound Image Analysis via Self-Adaptive Masked Contrastive Learning

  • 自适应掩码对比学习,结合注意力图与重建损失优化特征提取
  • 基于30.8万张超声图像构建最大公开数据集,覆盖42个数据源
  • 适配多种临床任务,支持少样本微调,代码开源可复现

超声成像因成本低、便携、实时且无电离辐射而广泛应用,但其解读高度依赖操作者,受解剖区域、采集协议和设备类型影响显著。噪声(如斑点)、对比度低及标注标准化不足等问题制约了通用、高效超声AI模型的发展。本文提出OpenUS,首个可复现的开源超声基础模型,基于大规模公共数据训练。模型采用视觉Mamba骨干网络,捕捉图像中局部与全局长程依赖。为增强预训练效果,提出一种新颖的自适应掩码框架,融合对比学习与掩码图像建模,利用教师注意力图动态调整掩码策略,聚焦临床相关区域。同时引入动态学习率调度,逐步提升预训练难度。模型训练依托迄今最大的公开超声数据集,涵盖42个公开数据集,共308,000余张图像,覆盖多样解剖部位、机构、设备和疾病类型。预训练后的OpenUS可作为骨干网络,通过少量标注数据快速适配下游任务。代码已开源:https://github.com/XZheng0427/OpenUS。

原文摘要 · Abstract (English)

Ultrasound (US) is one of the most widely used medical imaging modalities, thanks to its low cost, portability, real-time feedback, and absence of ionizing radiation. However, US image interpretation remains highly operator-dependent and varies significantly across anatomical regions, acquisition protocols, and device types. These variations, along with unique challenges such as speckle, low contrast, and limited standardized annotations, hinder the development of generalizable, label-efficient ultrasound AI models. In this paper, we propose OpenUS, the first reproducible, open-source ultrasound foundation model built on a large collection of public data. OpenUS employs a vision Mamba backbone, capturing both local and global long-range dependencies across the image. To extract rich features during pre-training, we introduce a novel self-adaptive masking framework that combines contrastive learning with masked image modeling. This strategy integrates the teacher's attention map with student reconstruction loss, adaptively refining clinically-relevant masking to enhance pre-training effectiveness. OpenUS also applies a dynamic learning schedule to progressively adjust the difficulty of the pre-training process. To develop the foundation model, we compile the largest to-date public ultrasound dataset comprising over 308K images from 42 publicly available datasets, covering diverse anatomical regions, institutions, imaging devices, and disease types. Our pre-trained OpenUS model can be easily adapted to specific downstream tasks by serving as a backbone for label-efficient fine-tuning. Code is available at https://github.com/XZheng0427/OpenUS.

超声影像基础模型自监督学习开源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。