无需额外参数,让2D模型高效实现3D乳腺癌检测
From 2D to 3D Without Extra Baggage: Data-Efficient Cancer Detection in Digital Breast Tomosynthesis
- 用3D特征融合+切片信息迭代混合实现无参3D推理
- 低数据下定位准确率提升10%-47%,分类提升2%-10%
- 可直接迁移2D模型权重,适合数据稀缺的医疗场景
数字乳腺断层成像(DBT)通过提供体素信息提升乳腺癌检出率,但标注数据有限制约了深度学习模型的发展。现有方法或扁平化处理DBT体积,或采用复杂3D架构,均需更多数据。为此,本文提出M&M-3D,可在不增加参数的前提下实现可学习的3D推理。该模型构建恶性病变引导的3D特征,并通过反复混合3D特征与切片级信息实现3D推理,仅修改原有M&M模型操作,支持直接权重迁移。大量实验表明,相较于2D投影和切片方法,M&M-3D在定位上提升11%-54%,分类提升3%-10%;在低数据条件下,优于复杂3D模型20%-47%(定位)和2%-10%(分类),高数据下性能相当。在BCS-DBT基准测试中,分类准确率领先前顶尖基线4%,定位提升10%。
原文摘要 · Abstract (English)
Digital Breast Tomosynthesis (DBT) enhances finding visibility for breast cancer detection by providing volumetric information that reduces the impact of overlapping tissues; however, limited annotated data has constrained the development of deep learning models for DBT. To address data scarcity, existing methods attempt to reuse 2D full-field digital mammography (FFDM) models by either flattening DBT volumes or processing slices individually, thus discarding volumetric information. Alternatively, 3D reasoning approaches introduce complex architectures that require more DBT training data. Tackling these drawbacks, we propose M&M-3D, an architecture that enables learnable 3D reasoning while remaining parameter-free relative to its FFDM counterpart, M&M. M&M-3D constructs malignancy-guided 3D features, and 3D reasoning is learned through repeatedly mixing these 3D features with slice-level information. This is achieved by modifying operations in M&M without adding parameters, thus enabling direct weight transfer from FFDM. Extensive experiments show that M&M-3D surpasses 2D projection and 3D slice-based methods by 11-54% for localization and 3-10% for classification. Additionally, M&M-3D outperforms complex 3D reasoning variants by 20-47% for localization and 2-10% for classification in the low-data regime, while matching their performance in high-data regime. On the popular BCS-DBT benchmark, M&M-3D outperforms previous top baseline by 4% for classification and 10% for localization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。