用上下文语义引导生成骨骼肌超声图像,提升真实感与多样性。
CSG: A Context-Semantic Guided Diffusion Approach in De Novo Musculoskeletal Ultrasound Image Generation

- 通过结构与外观双重条件控制生成图像
- 合成图像使分割模型性能提升,媲美真实数据
- 适合医学影像数据增强与生成任务的研究者
在医学影像AI中,合成图像有助于缓解数据稀缺、偏差和代表性不足的问题。尽管已有大量生成方法,但对语义多样性和上下文细节的控制仍具挑战。本文提出可扩展的语义与上下文条件生成模型CSG,实现对结构和外观的全面控制,显著提升超声图像的真实感与多样性。实验表明,CSG可生成骨骼肌超声中的病理异常,并在三重验证中表现优异:合成图像提升语义分割模型性能,与真实图像相似度更高,且通过图灵测试难以区分。此外,该方法还可通过合成解剖几何与纹理增强图像变异空间。
原文摘要 · Abstract (English)
The use of synthetic images in medical imaging Artificial Intelligence (AI) solutions has been shown to be beneficial in addressing the limited availability of diverse, unbiased, and representative data. Despite the extensive use of synthetic image generation methods, controlling the semantics variability and context details remains challenging, limiting their effectiveness in producing diverse and representative medical image datasets. In this work, we introduce a scalable semantic and context-conditioned generative model, coined CSG (Context-Semantic Guidance). This dual conditioning approach allows for comprehensive control over both structure and appearance, advancing the synthesis of realistic and diverse ultrasound images. We demonstrate the ability of CSG to generate findings (pathological anomalies) in musculoskeletal (MSK) ultrasound images. Moreover, we test the quality of the synthetic images using a three-fold validation protocol. The results show that the synthetic images generated by CSG improve the performance of semantic segmentation models, exhibit enhanced similarity to real images compared to the baseline methods, and are undistinguishable from real images according to a Turing test. Furthermore, we demonstrate an extension of the CSG that allows enhancing the variability space of images by synthetically generating augmentations of anatomical geometries and textures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。