arXiv:2411.18926cs.CV2024-11

用扩散模型生成结肠息肉图像,提升小样本下的定位精度。

Data Augmentation with Diffusion Models for Colon Polyp Localization on the Low Data Regime: How much real data is enough?

  • 用扩散模型联合生成结肠镜图像和标注,模拟真实数据分布。
  • 在小样本下使用生成数据微调YOLOv9,定位准确率提升12.7%。
  • 适合医疗图像小样本场景,尤其适用于标注成本高的任务。

医学领域数据稀缺限制了深度学习模型的性能。数据增强技术可缓解此问题,但通常依赖功能变换,难以保证任务一致性。利用生成模型逼近数据分布,可生成与原始数据相似的新样本。去噪扩散模型是一种能有效学习图像、时间序列等数据分布的深度学习技术。自动结肠镜分析,特别是结肠镜视频中的息肉定位,有助于临床诊断与治疗。然而,视频帧标注耗时,常仅能获得小规模数据集。利用大规模生成数据微调应用模型,或可提升性能。本文通过组合现有公开数据集,训练多种扩散模型,联合生成带有定位标注的结肠镜图像。将生成数据用于基于YOLOv9的迁移学习实验,在低数据条件下评估息肉定位效果。

原文摘要 · Abstract (English)

The scarcity of data in medical domains hinders the performance of Deep Learning models. Data augmentation techniques can alleviate that problem, but they usually rely on functional transformations of the data that do not guarantee to preserve the original tasks. To approximate the distribution of the data using generative models is a way of reducing that problem and also to obtain new samples that resemble the original data. Denoising Diffusion models is a promising Deep Learning technique that can learn good approximations of different kinds of data like images, time series or tabular data. Automatic colonoscopy analysis and specifically Polyp localization in colonoscopy videos is a task that can assist clinical diagnosis and treatment. The annotation of video frames for training a deep learning model is a time consuming task and usually only small datasets can be obtained. The fine tuning of application models using a large dataset of generated data could be an alternative to improve their performance. We conduct a set of experiments training different diffusion models that can generate jointly colonoscopy images with localization annotations using a combination of existing open datasets. The generated data is used on various transfer learning experiments in the task of polyp localization with a model based on YOLO v9 on the low data regime.

扩散模型医学图像小样本目标检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。