用图神经网络融合切片特征,提升医学图像语义合成的准确性与一致性。
AnatoMaskGAN: GNN-Driven Slice Feature Fusion and Noise Augmentation for Medical Semantic Image Synthesis
- 通过图神经网络建模切片间空间关系,融合上下文信息增强解剖细节。
- 引入三维空间噪声注入策略,提升结构多样性的建模能力。
- 结合灰度纹理分类器优化生成图像的分布与质感,适合医学影像分析场景。
医学语义掩码合成可增强数据并支持分析,但现有基于GAN的方法仍多为单对一生成,且在复杂扫描中缺乏空间一致性。为此,本文提出AnatoMaskGAN,一种新型合成框架,通过嵌入切片相关空间特征以精确聚合切片间上下文依赖,引入多样图像增强策略,并优化深度特征学习以提升复杂医学图像表现。具体地,设计基于图神经网络的强相关切片特征融合模块,建模切片间空间关系并整合邻近切片上下文信息,更全面捕捉解剖细节;提出三维空间噪声注入策略,加权融合空间特征与噪声,增强结构多样性建模;引入灰度-纹理分类器,优化生成过程中的灰度分布与纹理表征。在公开数据集L2R-OASIS和L2R-Abdomen CT上的大量实验表明,AnatoMaskGAN在L2R-OASIS上将PSNR提升至26.50 dB(较当前最优提升0.43 dB),在L2R-Abdomen CT上实现SSIM 0.8602(比最佳模型提高0.48个百分点),证明其在重建精度与感知质量上的优越性。消融实验证明,切片特征融合模块、三维空间噪声注入策略及灰度纹理分类器各自对PSNR、SSIM和LPIPS均有显著贡献,进一步验证各核心设计独立价值。
原文摘要 · Abstract (English)
Medical semantic-mask synthesis boosts data augmentation and analysis, yet most GAN-based approaches still produce one-to-one images and lack spatial consistency in complex scans. To address this, we propose AnatoMaskGAN, a novel synthesis framework that embeds slice-related spatial features to precisely aggregate inter-slice contextual dependencies, introduces diverse image-augmentation strategies, and optimizes deep feature learning to improve performance on complex medical images. Specifically, we design a GNN-based strongly correlated slice-feature fusion module to model spatial relationships between slices and integrate contextual information from neighboring slices, thereby capturing anatomical details more comprehensively; we introduce a three-dimensional spatial noise-injection strategy that weights and fuses spatial features with noise to enhance modeling of structural diversity; and we incorporate a grayscale-texture classifier to optimize grayscale distribution and texture representation during generation. Extensive experiments on the public L2R-OASIS and L2R-Abdomen CT datasets show that AnatoMaskGAN raises PSNR on L2R-OASIS to 26.50 dB (0.43 dB higher than the current state of the art) and achieves an SSIM of 0.8602 on L2R-Abdomen CT--a 0.48 percentage-point gain over the best model, demonstrating its superiority in reconstruction accuracy and perceptual quality. Ablation studies that successively remove the slice-feature fusion module, spatial 3D noise-injection strategy, and grayscale-texture classifier reveal that each component contributes significantly to PSNR, SSIM, and LPIPS, further confirming the independent value of each core design in enhancing reconstruction accuracy and perceptual quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。