让医疗影像生成更公平,能合成罕见群体交集图像。
CompDiff: Hierarchical Compositional Diffusion for Fair and Zero-Shot Intersectional Medical Image Generation
- 用分层条件网络分解人口属性,实现结构化建模
- 在胸部X光和眼底图上,生成质量提升21%且均衡性更好
- 适合需要公平生成、零样本泛化的医学AI研究者
生成模型被广泛用于扩充医疗影像数据以实现更公平的AI,但一个关键假设常被忽视:生成器对不同人口群体的输出质量是否一致。在数据不平衡的情况下,模型会继承这些偏差,导致稀有亚群生成质量下降,且无法处理训练中未出现的交集——即不平衡生成问题。现有修复方法如损失重加权仅在优化层面起效,在信号稀缺或缺失时效果有限。我们提出CompDiff,一种分层组合扩散框架,从表征层面解决该问题。专用的分层条件网络(HCN)将人口条件分解为单属性、成对及组合表示,生成与CLIP嵌入拼接的语义标记作为交叉注意力上下文。这种结构化分解促进跨亚群参数共享,支持对罕见或未见交集的组合泛化。在胸部X光(MIMIC-CXR)和眼底图像(FairGenMed)上,CompDiff相比标准微调和FairDiffusion在图像质量(FID 64.3 vs. 75.1)、子群公平性(ES-FID)以及零样本交集泛化(在未见交集上最高提升21% FID)方面表现更优。基于CompDiff生成数据训练的下游分类器展现出更高的AUROC并降低人口偏差,表明人口条件的架构设计是公平医疗影像生成中一个重要且被忽视的因素。代码已开源。
原文摘要 · Abstract (English)
Generative models are increasingly used to augment medical imaging datasets for fairer AI, yet a key assumption often goes unexamined: that generators produce equally high-quality images across demographic groups. Models trained on imbalanced data inherit these imbalances, degrading synthesis for rare subgroups and struggling with intersections absent from training: the imbalanced generator problem. Remedies such as loss reweighting operate at the optimization level and provide limited benefit when training signal is scarce or absent. We propose CompDiff, a hierarchical compositional diffusion framework that addresses this at the representation level. A dedicated Hierarchical Conditioner Network (HCN) decomposes demographic conditioning into single-attribute, pairwise, and composed representations, producing a demographic token concatenated with CLIP embeddings as cross-attention context. This structured factorization encourages parameter sharing across subgroups and supports compositional generalization to rare or unseen intersections. On chest X-rays (MIMIC-CXR) and fundus images (FairGenMed), CompDiff compares favorably against standard fine-tuning and FairDiffusion across image quality (FID 64.3 vs. 75.1), subgroup equity (ES-FID), and zero-shot intersectional generalization (up to 21% FID improvement on held-out intersections). Downstream classifiers trained on CompDiff data show improved AUROC and reduced demographic bias, suggesting that the architectural design of demographic conditioning is an important and underexplored factor in fair medical image generation. Code: https://github.com/mahmoudibrahim98/CompDiff.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。