arXiv:2508.15920eess.IV2025-08

用潜在图结构生成保持解剖结构的医学影像,提升数据增强效果。

Structure-Preserving Medical Image Generation from a Latent Graph Representation

  • 从胸片中学习潜在图表示,捕捉图像内在结构关系。
  • 通过图卷积网络重建影像,生成结构一致的合成图像,分类与分割性能分别提升3%和2%。
  • 适合医学图像生成、数据增强及结构敏感任务的研究者使用。

监督学习在数据丰富的场景中表现优异,但在医学影像领域受限于数据稀缺,因获取成本高且图像特征复杂。为缓解数据不足,现有增强技术依赖几何变换、色彩调整及生成模型合成,但常忽略胸片等图像的高度结构性。当前生成模型盲目合成,难以保留解剖约束、代表性结构或跨数据集的结构相似性。本文提出一种新生成模型,通过学习潜在图表示(LGR)来建模医学图像的结构相似性。设计端到端模型,联合学习LGR以捕捉胸片内在结构,并利用图卷积网络(GCN)从LGR重构胸片图像。采用对抗训练引导生成器与判别器学习所学LGR的分布。基于训练好的GCN,本方法通过映射生成的LGR生成结构保持的合成图像。此外,评估了所学图表示在图像分类与分割中的应用。数值实验表明,该方法使分类与分割性能分别提升最多3%和2%。

原文摘要 · Abstract (English)

Supervised learning techniques have proven their efficacy in many applications with abundant data. However, applying these methods to medical imaging is challenging due to the scarcity of data, given the high acquisition costs and intricate data characteristics of those images, thereby limiting the full potential of deep neural networks. To address the lack of data, augmentation techniques leverage geometry, color, and the synthesis ability of generative models (GMs). Despite previous efforts, gaps in the generation process limit the impact of data augmentation to improve understanding of medical images, e.g., the highly structured nature of some domains, such as X-ray images, is ignored. Current GMs rely solely on the network's capacity to blindly synthesize augmentations that preserve semantic relationships of chest X-ray images, such as anatomical restrictions, representative structures, or structural similarities consistent across datasets. In this paper, we introduce a novel GM that leverages the structural resemblance of medical images by learning a latent graph representation (LGR). We design an end-to-end model to learn (i) a LGR that captures the intrinsic structure of X-ray images and (ii) a graph convolutional network (GCN) that reconstructs the X-ray image from the LGR. We employ adversarial training to guide the generator and discriminator models in learning the distribution of the learned LGR. Using the learned GCN, our approach generates structure-preserving synthetic images by mapping generated LGRs to X-ray. Additionally, we evaluate the learned graph representation for other tasks, such as X-ray image classification and segmentation. Numerical experiments demonstrate the efficacy of our approach, increasing performance up to $3\%$ and $2\%$ for classification and segmentation, respectively.

医学图像生成模型结构保持数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。