arXiv:2510.07129cs.CVcs.AI2025-10

用图结构控制病理图像生成,提升医学图像合成精度。

Graph Conditioned Diffusion for Controllable Histopathology Image Generation

  • 用图表示图像中各结构及其关系,实现细粒度控制。
  • 生成图像在分割任务中可替代真实标注数据。
  • 适合需要可控医学图像生成的研究者使用。

扩散概率模型(DPMs)在高质量图像合成方面取得进展,但在医疗图像等敏感领域实现可控生成仍具挑战。医学图像具有空间布局、形状和纹理等固有结构,对诊断至关重要。现有DPMs在噪声潜空间中运行,缺乏语义结构和强先验,难以确保生成内容的合理性。为此,本文提出基于图的物体级表示方法——图条件扩散(Graph-Conditioned Diffusion)。该方法生成对应图像中每个主要结构的图节点,编码其特征与关系。通过Transformer模块处理图信息,并以文本条件机制融入扩散模型,实现生成过程的精细控制。我们在真实病理图像场景下评估该方法,结果表明生成数据可在下游分割任务中可靠替代标注患者数据。代码已公开。

原文摘要 · Abstract (English)

Recent advances in Diffusion Probabilistic Models (DPMs) have set new standards in high-quality image synthesis. Yet, controlled generation remains challenging, particularly in sensitive areas such as medical imaging. Medical images feature inherent structure such as consistent spatial arrangement, shape or texture, all of which are critical for diagnosis. However, existing DPMs operate in noisy latent spaces that lack semantic structure and strong priors, making it difficult to ensure meaningful control over generated content. To address this, we propose graph-based object-level representations for Graph-Conditioned-Diffusion. Our approach generates graph nodes corresponding to each major structure in the image, encapsulating their individual features and relationships. These graph representations are processed by a transformer module and integrated into a diffusion model via the text-conditioning mechanism, enabling fine-grained control over generation. We evaluate this approach using a real-world histopathology use case, demonstrating that our generated data can reliably substitute for annotated patient data in downstream segmentation tasks. The code is available here.

图像生成扩散模型医学影像图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。