arXiv:2605.12430cs.CV2026-05中稿 · CVPR

用自监督预训练+上下文检索,实现半导体焊线检测的快速适应。

AOI-SSL: Self-Supervised Framework for Efficient Segmentation of Wire-bonded Semiconductors In Optical Inspection

论文配图:AOI-SSL: Self-Supervised Framework for Efficient Segmentation of Wire-bonded Semiconductors In Optical Inspection
图 1 · 摘自论文原文
  • 基于小数据自监督预训练视觉变压器,减少标注依赖。
  • 在固定计算预算下,分割精度优于从零训练和ImageNet预训练模型。
  • 无需额外训练即可通过相似性检索直接生成分割掩码,适合快速部署。

在半导体焊线自动光学检测中,分割模型通常依赖特定设备,新设备或分布变化时需重新训练。本文提出AOI-SSL框架,通过结合小领域自监督预训练与上下文推理,显著降低对标注样本的需求。我们在小型工业检测数据集上预训练主流自监督算法,发现掩码自编码器在小数据场景下最有效,能提升下游分割性能并减少微调工作量。进一步引入无需额外训练的上下文、像素级检索方法,直接从密集编码嵌入预测掩码。实验表明,简单相似性检索性能与现有复杂注意力聚合相当。在固定微调计算预算下,自监督预训练显著优于从零训练及ImageNet预训练模型。此外,检索式分割在单设备图像上表现优于微调,实现对困难样本的近实时适配。

原文摘要 · Abstract (English)

Segmentation models in automated optical inspection of wire-bonded semiconductors are typically device-specific and must be re-trained when new devices or distribution shifts appear. We introduce AOI-SSL, a training-efficient framework for semantic segmentation of wire-bonded semiconductors by combining small-domain self-supervised pre-training of vision transformers with in-context inference that minimizes the need of labeled examples. We pre-train SOTA self-supervised algorithms in a small industrial inspection dataset and find that Masked Autoencoders are the most effective in this small-data setting, improving downstream segmentation while reducing the labeled fine-tuning effort. We further introduce in-context, patch-level retrieval methods that predict masks directly from dense encoder embeddings with negligible additional training. We show that, in this setting, simple similarity-based retrieval performs on par with more complex attention-based aggregation used currently in the literature. Furthermore, our experiments demonstrate that self-supervised pre-training significantly improves segmentation quality compared to training from scratch and to ImageNet pre-trained backbones under a fixed fine-tuning computational budget. Finally, the results reveal that retrieval based segmentation outperforms fine-tuning when targeting single device images, allowing for near-instant adaptation to difficult samples.

自监督学习图像分割工业检测视觉变压器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。