arXiv:2412.20374cs.CVcs.LG2024-12被引 11

提出FairDiffusion模型,提升医疗图像生成的公平性

FairDiffusion: Enhancing Equity in Latent Diffusion Models via Fair Bayesian Perturbation

  • 通过贝叶斯扰动增强潜空间扩散模型的公平性
  • 在性别、种族和族裔间显著降低生成质量差异
  • 适合医疗AI公平性研究者与临床生成模型开发者

近年来,生成式AI尤其是扩散模型在文本到图像合成中表现出显著效能,尤其在医疗领域具有生成合成数据集和培训医学生的重要潜力。然而,图像生成质量是否在不同人口统计学子群体中保持一致仍不明确。为此,我们首次对医疗文本到图像扩散模型的公平性进行了全面研究。对主流Stable Diffusion模型的广泛评估揭示了性别、种族和民族之间的显著差异。为缓解这些偏差,我们提出FairDiffusion,一种注重公平性的潜空间扩散模型,提升了图像生成质量及临床特征语义关联的一致性。此外,我们还构建并整理了首个用于研究医疗生成模型公平性的数据集FairGenMed。为进一步验证有效性,我们在两个广泛应用的外部医学数据集上评估了FairDiffusion:HAM10000(皮肤镜图像)和CheXpert(胸部X光片),证明其在多种医学影像模态中均能有效解决公平性问题。FairDiffusion与FairGenMed共同推动了公平生成学习的研究,促进生成式AI在医疗领域的公平受益。

原文摘要 · Abstract (English)

Recent progress in generative AI, especially diffusion models, has demonstrated significant utility in text-to-image synthesis. Particularly in healthcare, these models offer immense potential in generating synthetic datasets and training medical students. However, despite these strong performances, it remains uncertain if the image generation quality is consistent across different demographic subgroups. To address this critical concern, we present the first comprehensive study on the fairness of medical text-to-image diffusion models. Our extensive evaluations of the popular Stable Diffusion model reveal significant disparities across gender, race, and ethnicity. To mitigate these biases, we introduce FairDiffusion, an equity-aware latent diffusion model that enhances fairness in both image generation quality as well as the semantic correlation of clinical features. In addition, we also design and curate FairGenMed, the first dataset for studying the fairness of medical generative models. Complementing this effort, we further evaluate FairDiffusion on two widely-used external medical datasets: HAM10000 (dermatoscopic images) and CheXpert (chest X-rays) to demonstrate FairDiffusion's effectiveness in addressing fairness concerns across diverse medical imaging modalities. Together, FairDiffusion and FairGenMed significantly advance research in fair generative learning, promoting equitable benefits of generative AI in healthcare.

医疗生成公平性扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。