用四元组损失提升装配进度估计准确率,解决视觉变化微小导致的误判问题。
Robust Assembly Progress Estimation via Deep Metric Learning
- 基于四元组损失学习异常图像特征,增强对细微变化的感知能力。
- 在台式机装配数据集上准确率提升1.3%,相邻步骤误判率降低1.9%。
- 适用于人工多日装配场景,对遮挡和微小视觉变化具有强鲁棒性。
近年来,人工智能技术推动了智能工厂的发展。自动监控产品装配进度对于提升效率、减少废品成本、提高产能至关重要。然而,在人工分多日完成的装配任务中,实现智能监控仍面临挑战。已有研究提出异常三元组网络,通过深度度量学习分析产品视觉特征来估计装配进度,但在连续步骤间视觉变化微小时,易发生误分类。本文提出一种鲁棒的装配进度估计系统,即使在遮挡或视觉变化极小的情况下也有效,且仅需小规模数据集。方法采用基于四元组损失的学习策略,针对异常图像进行训练,并设计定制化数据加载器,有策略地选取训练样本以提升精度。在台式机装配过程中采集的图像数据集上评估表明,所提出的异常四元组网络优于现有方法:准确率提升1.3%,相邻步骤误判率降低1.9%,验证了该方法的有效性。
原文摘要 · Abstract (English)
In recent years, the advancement of AI technologies has accelerated the development of smart factories. In particular, the automatic monitoring of product assembly progress is crucial for improving operational efficiency, minimizing the cost of discarded parts, and maximizing factory productivity. However, in cases where assembly tasks are performed manually over multiple days, implementing smart factory systems remains a challenge. Previous work has proposed Anomaly Triplet-Net, which estimates assembly progress by applying deep metric learning to the visual features of products. Nevertheless, when visual changes between consecutive tasks are subtle, misclassification often occurs. To address this issue, this paper proposes a robust system for estimating assembly progress, even in cases of occlusion or minimal visual change, using a small-scale dataset. Our method leverages a Quadruplet Loss-based learning approach for anomaly images and introduces a custom data loader that strategically selects training samples to enhance estimation accuracy. We evaluated our approach using a image datasets: captured during desktop PC assembly. The proposed Anomaly Quadruplet-Net outperformed existing methods on the dataset. Specifically, it improved the estimation accuracy by 1.3% and reduced misclassification between adjacent tasks by 1.9% in the desktop PC dataset and demonstrating the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。