多视角相机+融合算法,精准识别装配缺陷螺丝。
A Multi-Camera Vision-Based Approach for Fine-Grained Assembly Quality Control
- 三视角拍摄+图像融合,解决遮挡与光照问题。
- 在复杂场景下检测精度和召回率显著优于单视角方法。
- 适合智能制造中高精度装配质检,数据集公开可用。
质量控制是制造中的关键环节,尤其在小型零部件装配过程中至关重要。现有方案多依赖单视角成像或人工检查,易受遮挡、视角受限或光照不均影响,且需增设检测工位,可能中断产线并增加停机时间和成本。本文提出一种新型多视角质量控制模块,结合三相机成像系统与先进目标检测算法,实现对装配过程中小部件的全面视觉覆盖。通过定制化的图像融合方法,有效消除视图歧义,提升检测可靠性。为支持该系统,构建了一个包含多种光照、遮挡和角度条件的标注数据集,增强其在真实制造环境中的适用性。实验结果表明,该方法在识别未正确拧紧的小型装配件(如螺丝)方面显著优于单视角方法,实现了高精度与高召回率。本工作推动了工业自动化发展,提供了一种可扩展、低成本且高精度的质量控制方案,保障产线可靠性与安全性。本研究使用的数据集已公开,以促进该领域进一步研究。
原文摘要 · Abstract (English)
Quality control is a critical aspect of manufacturing, particularly in ensuring the proper assembly of small components in production lines. Existing solutions often rely on single-view imaging or manual inspection, which are prone to errors due to occlusions, restricted perspectives, or lighting inconsistencies. These limitations require the installation of additional inspection stations, which could disrupt the assembly line and lead to increased downtime and costs. This paper introduces a novel multi-view quality control module designed to address these challenges, integrating a multi-camera imaging system with advanced object detection algorithms. By capturing images from three camera views, the system provides comprehensive visual coverage of components of an assembly process. A tailored image fusion methodology combines results from multiple views, effectively resolving ambiguities and enhancing detection reliability. To support this system, we developed a unique dataset comprising annotated images across diverse scenarios, including varied lighting conditions, occlusions, and angles, to enhance applicability in real-world manufacturing environments. Experimental results show that our approach significantly outperforms single-view methods, achieving high precision and recall rates in the identification of improperly fastened small assembly parts such as screws. This work contributes to industrial automation by overcoming single-view limitations, and providing a scalable, cost-effective, and accurate quality control mechanism that ensures the reliability and safety of the assembly line. The dataset used in this study is publicly available to facilitate further research in this domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。