用变化检测思路解决复杂背景下的缺陷分割,精度更高且模型更小。
Change-Aware Siamese Network for Surface Defects Segmentation under Complex Background
- 基于变换检测框架,通过对比学习统一建模各类缺陷差异。
- 在多类LCD缺陷数据集上达到新SOTA,尤其在弱监督下表现优异。
- 适合工业质检场景,尤其对背景复杂、缺陷少的场景有效。
尽管深度视觉网络在区域级表面缺陷检测中取得显著进展,但由于缺陷形态多样和数据稀缺,高质量像素级缺陷检测仍是挑战。为减少对缺陷外观的依赖并实现精准分割,本文提出一种变化感知的孪生网络,将缺陷分割问题置于变化检测框架中解决。引入新型多类别平衡对比损失,引导基于Transformer的编码器将各类缺陷统一建模为有缺陷与无缺陷图像间的类无关差异。该差异以距离图形式跳接至变化感知解码器,辅助定位跨类别及未见类别的像素级缺陷。此外,我们构建了一个包含多类液晶显示(LCD)缺陷的合成数据集,背景复杂且不连续,用于验证基于变化的建模相比基于外观的建模在缺陷分割中的优势。在所提数据集及两个公开数据集上,本模型性能优于主流语义分割方法,同时保持较小模型规模。在不同监督设置下,其表现超越现有半监督方法,达到新SOTA。
原文摘要 · Abstract (English)
Despite the eye-catching breakthroughs achieved by deep visual networks in detecting region-level surface defects, the challenge of high-quality pixel-wise defect detection remains due to diverse defect appearances and data scarcity. To avoid over-reliance on defect appearance and achieve accurate defect segmentation, we proposed a change-aware Siamese network that solves the defect segmentation in a change detection framework. A novel multi-class balanced contrastive loss is introduced to guide the Transformer-based encoder, which enables encoding diverse categories of defects as the unified class-agnostic difference between defect and defect-free images. The difference presented by a distance map is then skip-connected to the change-aware decoder to assist in the location of both inter-class and out-of-class pixel-wise defects. In addition, we proposed a synthetic dataset with multi-class liquid crystal display (LCD) defects under a complex and disjointed background context, to demonstrate the advantages of change-based modeling over appearance-based modeling for defect segmentation. In our proposed dataset and two public datasets, our model achieves superior performances than the leading semantic segmentation methods, while maintaining a relatively small model size. Moreover, our model achieves a new state-of-the-art performance compared to the semi-supervised approaches in various supervision settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。