用可控缺陷图生成合成TEM图像,提升小样本下的缺陷检测与分类效果。
Improving Combined Detection and Classification of TEM Defects via Mask-Conditioned Latent Diffusion Augmentation

- 基于掩码条件的潜空间扩散模型,自动生成带标签的缺陷图像对。
- 在10~100张真实图像上增广,检测分类F1调和均值提升最多0.02。
- 适合数据稀缺的微观结构分析任务,尤其适用于辐射损伤金属研究。
分析辐照金属合金的透射电镜(TEM)图像中的微结构缺陷,常受限于高质量标注数据的不足。为此,本文提出一种基于掩码条件潜空间扩散模型(LDM)的生成式数据增强方法,可合成具有可控、自动标注多类缺陷掩码的真实感TEM图像。该方法无需人工标注即可通过采样实验掩码学习到的分布生成合成图像-掩码对。这些生成数据被用于增广不同规模的真实数据集(10、50、100张标注图像),以训练掩码区域卷积神经网络(R-CNN)进行缺陷检测与分类。结果表明,生成式增广带来小幅整体性能提升,检测与分类F1得分调和平均最高提升0.02。但检测与分类的相对改进程度取决于具体训练/测试数据划分。研究凸显了针对性生成模型在数据匮乏的显微图像定量分析任务中提升深度学习表现的潜力。
原文摘要 · Abstract (English)
Analyzing microstructural defects in transmission electron microscopy (TEM) images, particularly in irradiated metal alloys, is often limited by the availability of high-quality, labeled data. To address this, we introduce a generative data augmentation approach using a mask-conditioned latent diffusion model (LDM) for synthesizing realistic TEM images with controllable, automatically labeled multi-class defect masks. Without requiring manual annotations for generation, our method enables the creation of synthetic image-mask pairs by sampling distributions learned from experimental masks. These generated data were used to augment small experimental datasets of varying sizes (10, 50, and 100 labeled experimental images) to train a Mask Regional Convolutional Neural Network (R-CNN) model for defect detection and classification. Our results show that generative augmentation yields small overall model performance improvements, with up to a 0.02 gain in the harmonic mean of detection and classification F1 scores. However, we also find that the relative contributions to detection and classification improvement depend on the specific train/test data split. These findings highlight the potential of targeted generative models to enhance deep learning performance in data-scarce microscopy-based image quantification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。