用自标注提升机器人意图识别,应对环境变化带来的适应难题。
Benchmarking Adaptive Intelligence and Computer Vision on Human-Robot Collaboration
- 结合自标注与自适应智能,动态优化意图识别模型。
- 骨骼姿态预处理使MViT2准确率达83%,高于无该处理的79%。
- 自标注准确率91%,大幅减少人工标注时间,适合工业部署。
人机协作(HRC)在工业4.0中至关重要,依赖传感器、数字孪生、协作机器人(cobots)和意图识别模型实现高效制造。然而,概念漂移(Concept Drift)是主要挑战,导致机器人难以适应新环境。本文通过融合自适应智能与自标注(SLB)机制,提升HRC系统中意图识别的鲁棒性。方法包括使用摄像头和重量传感器采集数据,标注意图与状态变化,并训练多种深度学习模型,结合不同预处理技术进行意图识别与预测。此外,开发了定制的状态检测算法,提供精确的状态变化定义与时间戳,支持高效自标注。实验结果表明,在特定数据环境下,加入骨骼姿态预处理的MViT2模型准确率达到83%,优于未使用该处理的79%;自标注机制实现91%的标注准确率,显著减少人工标注耗时。同时,通过在迁移域中逐步微调自标注数据,模型性能快速提升,有效缓解概念漂移。本研究为智能协作机器人在制造业中的快速部署提供了可行路径,推动更自适应、高效的HRC系统发展。
原文摘要 · Abstract (English)
Human-Robot Collaboration (HRC) is vital in Industry 4.0, using sensors, digital twins, collaborative robots (cobots), and intention-recognition models to have efficient manufacturing processes. However, Concept Drift is a significant challenge, where robots struggle to adapt to new environments. We address concept drift by integrating Adaptive Intelligence and self-labeling (SLB) to improve the resilience of intention-recognition in an HRC system. Our methodology begins with data collection using cameras and weight sensors, which is followed by annotation of intentions and state changes. Then we train various deep learning models with different preprocessing techniques for recognizing and predicting the intentions. Additionally, we developed a custom state detection algorithm for enhancing the accuracy of SLB, offering precise state-change definitions and timestamps to label intentions. Our results show that the MViT2 model with skeletal posture preprocessing achieves an accuracy of 83% on our data environment, compared to the 79% accuracy of MViT2 without skeleton posture extraction. Additionally, our SLB mechanism achieves a labeling accuracy of 91%, reducing a significant amount of time that would've been spent on manual annotation. Lastly, we observe swift scaling of model performance that combats concept drift by fine tuning on different increments of self-labeled data in a shifted domain that has key differences from the original training environment.. This study demonstrates the potential for rapid deployment of intelligent cobots in manufacturing through the steps shown in our methodology, paving a way for more adaptive and efficient HRC systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。