用自监督预训练+上下文检索,实现半导体焊线检测的快速适应。
AOI-SSL: Self-Supervised Framework for Efficient Segmentation of Wire-bonded Semiconductors In Optical Inspection

- 基于小数据自监督预训练视觉变压器,减少标注依赖。
- 在固定计算预算下,分割精度优于从零训练和ImageNet预训练模型。
- 无需额外训练即可通过相似性检索直接生成分割掩码,适合快速部署。
在半导体焊线自动光学检测中,分割模型通常依赖特定设备,新设备或分布变化时需重新训练。本文提出AOI-SSL框架,通过结合小领域自监督预训练与上下文推理,显著降低对标注样本的需求。我们在小型工业检测数据集上预训练主流自监督算法,发现掩码自编码器在小数据场景下最有效,能提升下游分割性能并减少微调工作量。进一步引入无需额外训练的上下文、像素级检索方法,直接从密集编码嵌入预测掩码。实验表明,简单相似性检索性能与现有复杂注意力聚合相当。在固定微调计算预算下,自监督预训练显著优于从零训练及ImageNet预训练模型。此外,检索式分割在单设备图像上表现优于微调,实现对困难样本的近实时适配。
原文摘要 · Abstract (English)
Segmentation models in automated optical inspection of wire-bonded semiconductors are typically device-specific and must be re-trained when new devices or distribution shifts appear. We introduce AOI-SSL, a training-efficient framework for semantic segmentation of wire-bonded semiconductors by combining small-domain self-supervised pre-training of vision transformers with in-context inference that minimizes the need of labeled examples. We pre-train SOTA self-supervised algorithms in a small industrial inspection dataset and find that Masked Autoencoders are the most effective in this small-data setting, improving downstream segmentation while reducing the labeled fine-tuning effort. We further introduce in-context, patch-level retrieval methods that predict masks directly from dense encoder embeddings with negligible additional training. We show that, in this setting, simple similarity-based retrieval performs on par with more complex attention-based aggregation used currently in the literature. Furthermore, our experiments demonstrate that self-supervised pre-training significantly improves segmentation quality compared to training from scratch and to ImageNet pre-trained backbones under a fixed fine-tuning computational budget. Finally, the results reveal that retrieval based segmentation outperforms fine-tuning when targeting single device images, allowing for near-instant adaptation to difficult samples.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。