arXiv:2507.16779eess.IVcs.CV2025-07ICCV

通过正则化与迁移学习,提升U-Net在电子显微镜图像中缺陷检测的准确率与模型自信心。

Improving U-Net Confidence on TEM Image Data with L2-Regularization, Transfer Learning, and Deep Fine-Tuning

  • 用预训练编码器结合L2正则化,抑制复杂特征,聚焦可靠简单线索。
  • 缺陷检测率提升57%,显著优于传统F1分数评估结果。
  • 适合需要高可靠性缺陷检测的材料科学领域研究者使用。

随着数据量持续增长,自动化识别透射电子显微镜(TEM)图像中的纳米级缺陷变得愈发重要。然而,与常规照片相比,TEM图像中的纳米缺陷因复杂的对比机制和精细结构而表现出更大变异性,导致标注数据稀少且人工标注误差高,严重制约机器学习模型性能提升。为此,我们采用自然图像预训练的大模型进行迁移学习,发现结合预训练编码器与L2正则化可抑制语义复杂特征,转而依赖更简单可靠的线索,显著提升模型表现。但该提升无法被传统评价指标(如F1-score)捕捉,因这些指标易受标注错误影响。因此,我们引入不依赖标注精度的新评价指标。以铀氧化物(UO2)TEM图像中的晶界检测为例,本方法使缺陷检测率提高57%,是本研究中该数据集上的稳健综合性能指标。最后,我们证明模型自信心仅通过深度迁移学习与深层参数微调才能实现。

原文摘要 · Abstract (English)

With ever-increasing data volumes, it is essential to develop automated approaches for identifying nanoscale defects in transmission electron microscopy (TEM) images. However, compared to features in conventional photographs, nanoscale defects in TEM images exhibit far greater variation due to the complex contrast mechanisms and intricate defect structures. These challenges often result in much less labeled data and higher rates of annotation errors, posing significant obstacles to improving machine learning model performance for TEM image analysis. To address these limitations, we examined transfer learning by leveraging large, pre-trained models used for natural images. We demonstrated that by using the pre-trained encoder and L2-regularization, semantically complex features are ignored in favor of simpler, more reliable cues, substantially improving the model performance. However, this improvement cannot be captured by conventional evaluation metrics such as F1-score, which can be skewed by human annotation errors treated as ground truth. Instead, we introduced novel evaluation metrics that are independent of the annotation accuracy. Using grain boundary detection in UO2 TEM images as a case study, we found that our approach led to a 57% increase in defect detection rate, which is a robust and holistic measure of model performance on the TEM dataset used in this work. Finally, we showed that model self-confidence is only achieved through transfer learning and fine-tuning of very deep layers.

图像分割迁移学习材料科学缺陷检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。