用扩散模型生成乳腺影像及对应病灶标注,解决数据不足问题。
Paired Image Generation with Diffusion-Guided Diffusion Models
- 通过额外训练扩散引导器,实现无条件生成图像与标注对。
- 生成的病灶区域质量高,且配对标注可用于监督训练。
- 适合医学图像数据稀缺场景,尤其适用于乳腺癌筛查研究。
数字乳腺断层扫描(DBT)中病灶分割对乳腺癌早期筛查至关重要。但致密乳腺组织常导致病灶隐蔽,使人工标注困难且耗时,造成标注数据匮乏。现有扩散模型用于数据增强时面临两大挑战:一是病灶隐蔽使模型难以学习其特征,导致生成质量低;二是仅能生成图像,无法生成对应标注,限制了生成数据在监督训练中的使用。本文提出一种成对图像生成方法,无需外部条件,通过为条件扩散模型训练额外的扩散引导器,实现图像与标注的联合生成。实验生成了配对的DBT切片和病灶掩码,并将其融入病灶分割任务的监督训练。结果表明,该方法在无外部条件情况下提升了生成质量,缓解了标注数据短缺,有效增强了下游任务性能。代码已开源:https://github.com/zhanghx1320/PIG。
原文摘要 · Abstract (English)
The segmentation of mass lesions in digital breast tomosynthesis (DBT) images is very significant for the early screening of breast cancer. However, the high-density breast tissue often leads to high concealment of the mass lesions, which makes manual annotation difficult and time-consuming. As a result, there is a lack of annotated data for model training. Diffusion models are commonly used for data augmentation, but the existing methods face two challenges. First, due to the high concealment of lesions, it is difficult for the model to learn the features of the lesion area. This leads to the low generation quality of the lesion areas, thus limiting the quality of the generated images. Second, existing methods can only generate images and cannot generate corresponding annotations, which restricts the usability of the generated images in supervised training. In this work, we propose a paired image generation method. The method does not require external conditions and can achieve the generation of paired images by training an extra diffusion guider for the conditional diffusion model. During the experimental phase, we generated paired DBT slices and mass lesion masks. Then, we incorporated them into the supervised training process of the mass lesion segmentation task. The experimental results show that our method can improve the generation quality without external conditions. Moreover, it contributes to alleviating the shortage of annotated data, thus enhancing the performance of downstream tasks. The source code is available at https://github.com/zhanghx1320/PIG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。