用无监督方法检测乳腺影像中的异常,提升AI模型泛化能力。
Unsupervised Hybrid framework for ANomaly Detection (HAND) -- applied to Screening Mammogram
- 结合CNN与Transformer的混合结构,通过重建损失和判别器区分正常与异常样本。
- 在内部和外部数据集上均优于基线模型,尤其在未见过的外部数据表现突出。
- 适合医学影像质量控制,无需接触敏感医疗数据即可提供可操作洞察。
分布外(OOD)检测对提升乳腺影像筛查中AI模型的泛化能力至关重要。由于外部数据集中对OOD样本先验知识有限,无监督生成学习成为优选方案,即训练模型识别分布内(ID)数据的正常特征。假设在推理阶段,模型能准确重构ID样本,而OOD样本因偏离正常性导致重建效果较差。受当前最优混合架构(结合CNN与Transformer)启发,我们开发了新型主干网络HAND,用于大规模数字乳腺筛查研究中的OOD检测。为提升学习效率,引入合成的OOD样本及潜空间中的并行判别器,以区分ID与OOD样本。对OOD重建损失施加梯度反转,惩罚模型学习异常重构。通过加权重建损失与判别器损失计算异常得分。在内部RSNA乳腺影像留出测试集和外部梅奥诊所人工标注数据集上,HAND模型优于编码器基线与GAN基线,且有趣的是也超越了混合CNN+Transformer基线。因此,所提出的HAND流程为外部筛查乳腺影像提供了自动化、高效的领域特定质量检查方案,在不直接接触私密医学影像数据的前提下,输出可行动洞察。
原文摘要 · Abstract (English)
Out-of-distribution (OOD) detection is crucial for enhancing the generalization of AI models used in mammogram screening. Given the challenge of limited prior knowledge about OOD samples in external datasets, unsupervised generative learning is a preferable solution which trains the model to discern the normal characteristics of in-distribution (ID) data. The hypothesis is that during inference, the model aims to reconstruct ID samples accurately, while OOD samples exhibit poorer reconstruction due to their divergence from normality. Inspired by state-of-the-art (SOTA) hybrid architectures combining CNNs and transformers, we developed a novel backbone - HAND, for detecting OOD from large-scale digital screening mammogram studies. To boost the learning efficiency, we incorporated synthetic OOD samples and a parallel discriminator in the latent space to distinguish between ID and OOD samples. Gradient reversal to the OOD reconstruction loss penalizes the model for learning OOD reconstructions. An anomaly score is computed by weighting the reconstruction and discriminator loss. On internal RSNA mammogram held-out test and external Mayo clinic hand-curated dataset, the proposed HAND model outperformed encoder-based and GAN-based baselines, and interestingly, it also outperformed the hybrid CNN+transformer baselines. Therefore, the proposed HAND pipeline offers an automated efficient computational solution for domain-specific quality checks in external screening mammograms, yielding actionable insights without direct exposure to the private medical imaging data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。