用专业描述生成皮肤病图像,解决数据稀缺问题
LesionGen: A Concept-Guided Diffusion Model for Dermatology Image Synthesis
- 基于专家标注和伪生成报告训练扩散模型,实现概念引导生成
- 仅用合成数据训练的模型分类准确率媲美真实数据
- 适合需要扩充皮肤病数据集的研究者使用
皮肤疾病分类的深度学习模型需要大量多样且标注精准的数据集,但受限于隐私、标注成本及人群代表性不足,此类资源常匮乏。尽管文本到图像扩散模型(T2I-DPMs)在医学图像合成中前景广阔,其在皮肤科的应用仍受限于现有数据集中缺乏丰富文本描述。本文提出LesionGen,一种临床启发的T2I-DPM框架,用于皮肤病图像合成。不同于以往依赖简单疾病标签的方法,LesionGen利用来自专家标注和伪生成的结构化、概念丰富的皮肤科描述进行训练。通过在高质量图像-文本对上微调预训练扩散模型,实现了基于有意义皮肤病描述的逼真且多样化的病变图像生成。实验表明,仅使用合成数据训练的模型,在分类准确率上可与真实数据训练模型相当,并在最差子群体表现上取得显著提升。代码与数据已公开。
原文摘要 · Abstract (English)
Deep learning models for skin disease classification require large, diverse, and well-annotated datasets. However, such resources are often limited due to privacy concerns, high annotation costs, and insufficient demographic representation. While text-to-image diffusion probabilistic models (T2I-DPMs) offer promise for medical data synthesis, their use in dermatology remains underexplored, largely due to the scarcity of rich textual descriptions in existing skin image datasets. In this work, we introduce LesionGen, a clinically informed T2I-DPM framework for dermatology image synthesis. Unlike prior methods that rely on simplistic disease labels, LesionGen is trained on structured, concept-rich dermatological captions derived from expert annotations and pseudo-generated, concept-guided reports. By fine-tuning a pretrained diffusion model on these high-quality image-caption pairs, we enable the generation of realistic and diverse skin lesion images conditioned on meaningful dermatological descriptions. Our results demonstrate that models trained solely on our synthetic dataset achieve classification accuracy comparable to those trained on real images, with notable gains in worst-case subgroup performance. Code and data are available here.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。