提出评估无配对训练下图像翻译模型可信度的方法
Trustworthy image-to-image translation: evaluating uncertainty calibration in unpaired training scenarios
- 用不确定性量化评估无配对训练的图像翻译模型
- 在三个乳腺钼靶数据集上验证模型校准效果
- 适合医疗影像领域需可信AI的场景
乳腺钼靶筛查是发现乳腺癌的有效手段,有助于早期诊断。然而,当前需人工逐幅检查图像,给医疗系统带来沉重负担,推动了自动化诊断流程的需求。深度神经网络技术在部分研究中表现有效,但其易过拟合导致泛化能力差,存在误诊风险,限制了其在临床环境中的广泛应用。基于无配对神经风格迁移的数据增强方案可通过多样化训练图像特征表示提升泛化性,但在缺乏成对数据(同一组织在不同图像风格下的对应图像)时仍存在多种病理问题,且因缺乏真实标签或大规模数据集,性能评估困难。本文比较了两种框架:基于GAN的CycleGAN与较新的扩散模型SynDiff。在三个公开乳腺钼靶数据集及一个非医学图像数据集的图像块上进行训练与评估。引入不确定性量化方法以评估模型可信度,并提出一种在无配对训练场景下评估校准质量的方案,最终促进在缺乏真实标签的领域中可信使用图像到图像翻译模型。
原文摘要 · Abstract (English)
Mammographic screening is an effective method for detecting breast cancer, facilitating early diagnosis. However, the current need to manually inspect images places a heavy burden on healthcare systems, spurring a desire for automated diagnostic protocols. Techniques based on deep neural networks have been shown effective in some studies, but their tendency to overfit leaves considerable risk for poor generalisation and misdiagnosis, preventing their widespread adoption in clinical settings. Data augmentation schemes based on unpaired neural style transfer models have been proposed that improve generalisability by diversifying the representations of training image features in the absence of paired training data (images of the same tissue in either image style). But these models are similarly prone to various pathologies, and evaluating their performance is challenging without ground truths/large datasets (as is often the case in medical imaging). Here, we consider two frameworks/architectures: a GAN-based cycleGAN, and the more recently developed diffusion-based SynDiff. We evaluate their performance when trained on image patches parsed from three open access mammography datasets and one non-medical image dataset. We consider the use of uncertainty quantification to assess model trustworthiness, and propose a scheme to evaluate calibration quality in unpaired training scenarios. This ultimately helps facilitate the trustworthy use of image-to-image translation models in domains where ground truths are not typically available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。