arXiv:2411.18602eess.IVcs.CV2024-11ICCV被引 5

用生成模型合成肺部X光片,提升医学影像分类与分割性能

Evaluating and Improving the Effectiveness of Synthetic Chest X-Rays for Medical Image Analysis

  • 基于文本或分割图条件生成合成胸部X光片
  • 分类F1最高提升0.150,分割Dice最高提升0.146
  • 适合数据稀缺场景下的医疗AI模型训练

目的:探索生成合成胸部X光片的最佳实践,以增强医学影像数据集,优化深度学习模型在分类与分割等下游任务中的表现。方法:采用潜在扩散模型,根据文本提示或分割掩码生成合成图像;通过代理模型和放射科医生反馈提升生成质量。合成图像基于疾病信息或几何变换的分割掩码生成,并加入CheXpert、CANDID-PTX、SIIM和RSNA Pneumonia数据集的真实训练图像中,评估分类与分割模型在测试集上的性能。使用F1分数和Dice分数分别评价分类与分割效果,采用单尾t检验结合邦弗朗尼校正分析显著性。结果:所有实验中,合成数据使分类平均F1分数最大提升0.150453(95%置信区间:0.099108–0.201798;P=0.0031);分割任务中最大Dice分数提升0.14575(95%置信区间:0.108267–0.183233;P=0.0064)。结论:生成合成胸部X光片的最佳实践包括基于单一疾病标签或几何变换的分割掩码进行条件生成,以及可选地使用代理模型进行微调。

原文摘要 · Abstract (English)

Purpose: To explore best-practice approaches for generating synthetic chest X-ray images and augmenting medical imaging datasets to optimize the performance of deep learning models in downstream tasks like classification and segmentation. Materials and Methods: We utilized a latent diffusion model to condition the generation of synthetic chest X-rays on text prompts and/or segmentation masks. We explored methods like using a proxy model and using radiologist feedback to improve the quality of synthetic data. These synthetic images were then generated from relevant disease information or geometrically transformed segmentation masks and added to ground truth training set images from the CheXpert, CANDID-PTX, SIIM, and RSNA Pneumonia datasets to measure improvements in classification and segmentation model performance on the test sets. F1 and Dice scores were used to evaluate classification and segmentation respectively. One-tailed t-tests with Bonferroni correction assessed the statistical significance of performance improvements with synthetic data. Results: Across all experiments, the synthetic data we generated resulted in a maximum mean classification F1 score improvement of 0.150453 (CI: 0.099108-0.201798; P=0.0031) compared to using only real data. For segmentation, the maximum Dice score improvement was 0.14575 (CI: 0.108267-0.183233; P=0.0064). Conclusion: Best practices for generating synthetic chest X-ray images for downstream tasks include conditioning on single-disease labels or geometrically transformed segmentation masks, as well as potentially using proxy modeling for fine-tuning such generations.

合成数据医学影像扩散模型肺部X光

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。