用可控合成数据提升医学影像模型的性能与公平性
Improving Performance, Robustness, and Fairness of Radiographic AI Models with Finely-Controllable Synthetic Data
- 通过文本生成控制患者特征和病灶,生成56万张带标签的合成胸片
- 合成数据预训练使分类模型准确率提升6.5%,公平性差距缩小19.3%
- 适合医疗AI研发者、临床部署团队及关注模型公平性的研究者
在开发可临床部署的诊断影像深度学习模型时,跨人群的鲁棒性与公平性仍是难题。合成数据生成成为缓解数据规模与多样性不足的可行策略。本文提出RoentGen-v2,一种用于胸部X光片的文本到图像扩散模型,可对影像病灶及患者性别、年龄、种族/族裔等人口属性实现细粒度控制。该模型是首个能生成具有人口属性条件的临床合理图像的模型,支持构建包含超过56.5万张图像的、人口均衡的合成数据集。我们利用该数据集评估下游疾病分类模型的最优训练流程。相比以往简单混合真实与合成数据的方法,本文提出先以合成数据进行监督预训练,再在真实数据上微调的新策略。在来自五家机构的超13.7万张胸片上评估显示,合成预训练显著提升了模型性能、分布外泛化能力及不同人口子群体间的公平性。相较简单混合仅提升2.7%准确率,合成预训练带来6.5%的提升,同时将误诊公平性差距减少19.3%。结果表明,合成影像可在真实数据受限条件下推动更公平、更通用的医疗深度学习发展。代码、训练模型与合成数据集已开源。
原文摘要 · Abstract (English)
Achieving robust performance and fairness across diverse patient populations remains a challenge in developing clinically deployable deep learning models for diagnostic imaging. Synthetic data generation has emerged as a promising strategy to address limitations in dataset scale and diversity. We introduce RoentGen-v2, a text-to-image diffusion model for chest radiographs that enables fine-grained control over both radiographic findings and patient demographic attributes, including sex, age, and race/ethnicity. RoentGen-v2 is the first model to generate clinically plausible images with demographic conditioning, facilitating the creation of a large, demographically balanced synthetic dataset comprising over 565,000 images. We use this large synthetic dataset to evaluate optimal training pipelines for downstream disease classification models. In contrast to prior work that combines real and synthetic data naively, we propose an improved training strategy that leverages synthetic data for supervised pretraining, followed by fine-tuning on real data. Through extensive evaluation on over 137,000 chest radiographs from five institutions, we demonstrate that synthetic pretraining consistently improves model performance, generalization to out-of-distribution settings, and fairness across demographic subgroups. Across datasets, synthetic pretraining led to a 6.5% accuracy increase in the performance of downstream classification models, compared to a modest 2.7% increase when naively combining real and synthetic data. We observe this performance improvement simultaneously with the reduction of the underdiagnosis fairness gap by 19.3%. These results highlight the potential of synthetic imaging to advance equitable and generalizable medical deep learning under real-world data constraints. We open source our code, trained models, and synthetic dataset at https://github.com/StanfordMIMI/RoentGen-v2 .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。