arXiv:2509.20271cs.CV2025-09被引 3

VersaMammo模型提升乳腺钼靶诊断,通用性强且表现领先。

A Versatile Foundation Model for AI-enabled Mammogram Interpretation

  • 两阶段预训练:自监督学习+知识蒸馏,提升模型泛化能力。
  • 在92项任务中50项内部、20项外部任务排名第一,平均排名1.5和1.2。
  • 基于70万张多机构数据训练,适合临床部署与跨场景应用。

乳腺癌是全球女性中最常见的癌症及癌症死亡主因。钼靶检查对早期发现乳腺病灶至关重要。尽管基础模型(FMs)在乳腺钼靶分析方面取得进展,但其临床应用仍受限于训练数据多样性不足、模型泛化能力差以及缺乏跨任务全面评估。本文提出VersaMammo,一种多功能乳腺钼靶基础模型,以克服上述挑战。我们构建了迄今最大的多机构乳腺钼靶数据集,包含来自21个来源的706,239张图像。为提升泛化性,采用两阶段预训练策略:首先通过自监督学习训练教师模型提取无标签图像中的可迁移特征;随后结合监督学习与知识蒸馏,将特征与临床知识注入VersaMammo。为全面评估,建立涵盖92项具体任务的基准,包括68项内部任务和24项外部验证任务,覆盖五大临床任务类别:病灶检测、分割、分类、图像检索与视觉问答。VersaMammo在68项内部任务中排名首位50次,在24项外部任务中20次排名第一,平均排名分别为1.5和1.2。结果表明其具备优异泛化性与临床价值,显著推进可靠、可扩展的乳腺癌筛查与诊断。

原文摘要 · Abstract (English)

Breast cancer is the most commonly diagnosed cancer and the leading cause of cancer-related mortality in women globally. Mammography is essential for the early detection and diagnosis of breast lesions. Despite recent progress in foundation models (FMs) for mammogram analysis, their clinical translation remains constrained by several fundamental limitations, including insufficient diversity in training data, limited model generalizability, and a lack of comprehensive evaluation across clinically relevant tasks. Here, we introduce VersaMammo, a versatile foundation model for mammograms, designed to overcome these limitations. We curated the largest multi-institutional mammogram dataset to date, comprising 706,239 images from 21 sources. To improve generalization, we propose a two-stage pre-training strategy to develop VersaMammo, a mammogram foundation model. First, a teacher model is trained via self-supervised learning to extract transferable features from unlabeled mammograms. Then, supervised learning combined with knowledge distillation transfers both features and clinical knowledge into VersaMammo. To ensure a comprehensive evaluation, we established a benchmark comprising 92 specific tasks, including 68 internal tasks and 24 external validation tasks, spanning 5 major clinical task categories: lesion detection, segmentation, classification, image retrieval, and visual question answering. VersaMammo achieves state-of-the-art performance, ranking first in 50 out of 68 specific internal tasks and 20 out of 24 external validation tasks, with average ranks of 1.5 and 1.2, respectively. These results demonstrate its superior generalization and clinical utility, offering a substantial advancement toward reliable and scalable breast cancer screening and diagnosis.

乳腺癌基础模型医学影像钼靶诊断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。