让机器人避开人手抓取,提升人机协作安全性
Quality-focused Active Adversarial Policy for Safe Grasping in Human-Robot Interaction
- 设计对抗性质量贴片,主动降低人手区域的抓取优先级
- 实时追踪手部形状,使贴片快速适应不同姿态
- 无需紧急停机即可安全抓取远离人体的物体
基于深度神经网络的视觉引导机器人抓取方法在处理未知物体方面取得了显著成功,得益于其强大的泛化能力。然而,这种泛化性导致系统常将人手及其邻近物体误判为可抓取目标,危及人机协作安全。为此,本文提出质量导向的主动对抗策略(QFAAP)。首先设计对抗性质量贴片(AQP),结合抓取数据集优化出高质量得分的贴片;其次构建投影质量梯度下降(PQGD),仅在每帧实时图像中包含手部区域,赋予AQP对人手形状的快速适应能力。通过AQP与PQGD协同作用,主动降低手部及周边物体的质量得分。最终将手部质量得分设为零,显著降低其抓取优先级,使机器人能安全抓取远离人手的物体,避免紧急停机。我们在基准数据集和协作机器人上进行了大量实验,验证了QFAAP的有效性。代码与演示视频见:https://github.com/clee-jaist/QFAAP。
原文摘要 · Abstract (English)
Vision-guided robot grasping methods based on Deep Neural Networks (DNNs) have achieved remarkable success in handling unknown objects, attributable to their powerful generalizability. However, these methods with this generalizability tend to recognize the human hand and its adjacent objects as graspable targets, compromising safety during Human-Robot Interaction (HRI). In this work, we propose the Quality-focused Active Adversarial Policy (QFAAP) to solve this problem. Specifically, the first part is the Adversarial Quality Patch (AQP), wherein we design the adversarial quality patch loss and leverage the grasp dataset to optimize a patch with high quality scores. Next, we construct the Projected Quality Gradient Descent (PQGD) and integrate it with the AQP, which contains only the hand region within each real-time frame, endowing the AQP with fast adaptability to the human hand shape. Through AQP and PQGD, the hand can be actively adversarial with the surrounding objects, lowering their quality scores. Therefore, further setting the quality score of the hand to zero will reduce the grasping priority of both the hand and its adjacent objects, enabling the robot to grasp other objects away from the hand without emergency stops. We conduct extensive experiments on the benchmark datasets and a cobot, showing the effectiveness of QFAAP. Our code and demo videos are available here: https://github.com/clee-jaist/QFAAP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。