用扩散模型生成逼真肾结石图像,提升内窥镜识别准确率
Evaluating the plausibility of synthetic images for improving automated endoscopic stone recognition
- 用扩散模型生成多样且逼真的肾结石图像以扩充数据集
- 混合真实与合成图像后,识别准确率提升10%(相比ImageNet预训练)
- 特别适合缺乏标注数据的医学图像识别任务
目前,形态-构成分析(MCA)是肾结石成因诊断的主流方法,对个性化治疗和预防复发至关重要。近年来研究转向术中实时识别,即内窥镜结石识别(ESR)。两者均依赖于结石表面和截面特征进行分类,但受限于观察者间差异大及术中条件复杂,亟需人工智能辅助诊断。然而现有AI模型需大量数据才能表现良好并泛化到未见分布,而大规模标注数据难以获取,部分结石类型尤为罕见。为此,本文提出基于扩散模型的方法,用于扩充体外肾结石数据集。目标是生成可用于预训练的逼真多样化肾结石图像。实验表明,将自然图像与合成图像混合后,模型在未见过的术中数据上表现优异:相比仅在ImageNet上预训练的基线模型,准确率提升10%;相比仅在CCD图像上训练的模型,表面图像提升6%,截面图像提升10%,验证了合成图像的有效性。
原文摘要 · Abstract (English)
Currently, the Morpho-Constitutional Analysis (MCA) is the de facto approach for the etiological diagnosis of kidney stone formation, and it is an important step for establishing personalized treatment to avoid relapses. More recently, research has focused on performing such tasks intra-operatively, an approach known as Endoscopic Stone Recognition (ESR). Both methods rely on features observed in the surface and the section of kidney stones to separate the analyzed samples into several sub-groups. However, given the high intra-observer variability and the complex operating conditions found in ESR, there is a lot of interest in using AI for computer-aided diagnosis. However, current AI models require large datasets to attain a good performance and for generalizing to unseen distributions. This is a major problem as large labeled datasets are very difficult to acquire, and some classes of kidney stones are very rare. Thus, in this paper, we present a method based on diffusion as a way of augmenting pre-existing ex-vivo kidney stone datasets. Our aim is to create plausible diverse kidney stone images that can be used for pre-training models using ex-vivo data. We show that by mixing natural and synthetic images of CCD images, it is possible to train models capable of performing very well on unseen intra-operative data. Our results show that is possible to attain an improvement of 10% in terms of accuracy compared to a baseline model pre-trained only on ImageNet. Moreover, our results show an improvement of 6% for surface images and 10% for section images compared to a model train on CCD images only, which demonstrates the effectiveness of using synthetic images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。