用视觉提示微调提升多视角乳腺钼靶图像的癌症检测精度
Breast Cancer Detection from Multi-View Screening Mammograms with Visual Prompt Tuning
- 通过提示微调将多视角信息融入预训练模型,仅调整7%参数
- 在大型多中心数据集上达到0.852的AUROC,区分良性和侵袭性癌
- 无需降采样即可高效融合高分辨率多视图数据,适合临床部署
从高分辨率乳腺钼靶图像中准确检测乳腺癌对早期诊断和治疗规划至关重要。以往研究已证明单视角图像可用于癌症检测,但多视角数据能提供更全面的信息。多视角分类在医学影像中面临独特挑战,尤其在处理大规模、高分辨率数据时。本文提出一种新型多视角视觉提示微调网络(MVPT-NET),先在高分辨率钼靶图像上预训练单视角分类模型,再创新性地将多视角特征学习融入任务特定的提示微调过程。该方法仅选择性调整少量可训练参数(7%),同时保留预训练模型的鲁棒性,实现无需激进降采样的高效多视角数据融合。实验在大型多机构数据集上验证,本方法优于传统融合方式,检测效率不降,且在区分良性、导管原位癌(DCIS)和侵袭性癌三类时达到0.852的AUROC。该工作展示了MVPT-NET在医学影像中的潜力,为乳腺癌检测提供了可扩展的多视角数据整合方案。
原文摘要 · Abstract (English)
Accurate detection of breast cancer from high-resolution mammograms is crucial for early diagnosis and effective treatment planning. Previous studies have shown the potential of using single-view mammograms for breast cancer detection. However, incorporating multi-view data can provide more comprehensive insights. Multi-view classification, especially in medical imaging, presents unique challenges, particularly when dealing with large-scale, high-resolution data. In this work, we propose a novel Multi-view Visual Prompt Tuning Network (MVPT-NET) for analyzing multiple screening mammograms. We first pretrain a robust single-view classification model on high-resolution mammograms and then innovatively adapt multi-view feature learning into a task-specific prompt tuning process. This technique selectively tunes a minimal set of trainable parameters (7\%) while retaining the robustness of the pre-trained single-view model, enabling efficient integration of multi-view data without the need for aggressive downsampling. Our approach offers an efficient alternative to traditional feature fusion methods, providing a more robust, scalable, and efficient solution for high-resolution mammogram analysis. Experimental results on a large multi-institution dataset demonstrate that our method outperforms conventional approaches while maintaining detection efficiency, achieving an AUROC of 0.852 for distinguishing between Benign, DCIS, and Invasive classes. This work highlights the potential of MVPT-NET for medical imaging tasks and provides a scalable solution for integrating multi-view data in breast cancer detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。