arXiv:2604.03637cs.CV2026-04

用注意力GAN生成逼真纳米颗粒图像,解决标注数据少难题

SAGE-GAN: Towards Realistic and Robust Segmentation of Spatially Ordered Nanoparticles via Attention-Guided GANs

  • 用自注意力U-Net提取关键形貌特征,忽略噪声和背景
  • 嵌入CycleGAN生成真实感图像与掩码对,提升分割精度
  • 无需人工标注即可自动扩充训练数据,适合材料科学领域

电子显微镜中纳米颗粒的精确分析对纳米材料发展至关重要。然而,手动方法耗时,传统自动化分割技术在复杂形状和成像伪影下表现不佳。现有方法依赖大量标注数据,获取困难且耗时。为此,我们提出两步方案:首先,采用自注意力驱动的U-Net架构,从真实图像中学习纳米颗粒的关键物理与形态特征,忽略背景与噪声;其次,将训练好的注意力U-Net嵌入循环一致生成对抗网络(CycleGAN)框架,借鉴cGAN-Seg模型思想,生成具有真实结构模式的合成电子显微图像-掩码对。该方法能准确检测多种真实纳米颗粒图像中的特征,并实现无监督的数据增强。循环一致性确保合成图像与真实掩码间存在直接对应关系,保障生成特征的真实性,对准确分割训练至关重要。

原文摘要 · Abstract (English)

Precise analysis of nanoparticles for characterization in electron microscopy images is essential for advancing nanomaterial development. Yet it remains challenging due to the time-consuming nature of manual methods and the shortcomings of traditional automated segmentation techniques, especially when dealing with complex shapes and imaging artifacts. While conventional methods yield promising results, they depend on a large volume of labeled training data, which is both difficult to acquire and highly time-consuming to generate. In order to overcome these challenges, we have developed a two-step solution: Firstly, our system learns to segment the key features of nanoparticles from a dataset of real images using a self-attention driven U-Net architecture that focuses on important physical and morphological details while ignoring background features and noise. Secondly, this trained Attention U-Net is embedded in a cycle-consistent generative adversarial network (CycleGAN) framework, inspired by the cGAN-Seg model introduced by Abzargar et al. This integration allows for the creation of highly realistic synthetic electron microscopy image-mask pairs that naturally reflect the structural patterns learned by the Attention U-Net. Consequently, the model can accurately detect features in a diverse array of real-world nanoparticle images and autonomously augment the training dataset without requiring human input. Cycle consistency enforces a direct correspondence between synthetic images and ground-truth masks, ensuring realistic features, which is crucial for accurate segmentation training.

纳米颗粒图像分割生成模型自注意力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。