arXiv:2412.10349cs.ROcs.CV2024-12被引 9

通过触觉反馈隐式校准视觉引导机械臂的力控,防止开门时损坏设备。

Ensuring Force Safety in Vision-Guided Robotic Manipulation via Implicit Tactile Calibration

  • 用触觉信号隐式校准状态空间,优化力控规划
  • 在模拟与真实场景中显著降低开门时的有害力
  • 首个专注力安全的视觉-触觉协同机械臂方法

在动态环境中,机器人在操作具有特定属性的物体(如门)时常面临运动轨迹受限的问题,因此施加合适的力至关重要,以避免对机器人或物体造成损伤。然而,现有基于视觉的机器人状态生成方法往往因缺乏触觉感知而表现不佳。为此,本文提出一种名为SafeDiff的新状态扩散框架,从当前机器人状态和视觉上下文观测出发,生成未来状态序列,并利用实时触觉反馈进行修正。据我们所知,这是首个专注于确保机器人操作中力安全性的研究。该方法显著提升了状态规划的合理性,进而基于逆动力学生成安全动作轨迹。不同于以往将视觉与触觉数据拼接生成未来状态的方法,本方法将触觉数据作为校准信号,隐式调整机器人状态空间内的状态。此外,我们构建了一个大规模仿真数据集SafeDoorManip50k,提供丰富的多模态数据以训练和评估该方法。大量实验表明,所提出的视觉-触觉模型在模拟与真实场景中均能有效降低开门过程中的有害力风险。

原文摘要 · Abstract (English)

In dynamic environments, robots often encounter constrained movement trajectories when manipulating objects with specific properties, such as doors. Therefore, applying the appropriate force is crucial to prevent damage to both the robots and the objects. However, current vision-guided robot state generation methods often falter in this regard, as they lack the integration of tactile perception. To tackle this issue, this paper introduces a novel state diffusion framework termed SafeDiff. It generates a prospective state sequence from the current robot state and visual context observation while incorporating real-time tactile feedback to refine the sequence. As far as we know, this is the first study specifically focused on ensuring force safety in robotic manipulation. It significantly enhances the rationality of state planning, and the safe action trajectory is derived from inverse dynamics based on this refined planning. In practice, unlike previous approaches that concatenate visual and tactile data to generate future robot state sequences, our method employs tactile data as a calibration signal to adjust the robot's state within the state space implicitly. Additionally, we've developed a large-scale simulation dataset called SafeDoorManip50k, offering extensive multimodal data to train and evaluate the proposed method. Extensive experiments show that our visual-tactile model substantially mitigates the risk of harmful forces in the door opening, across both simulated and real-world settings.

力控制触觉融合机器人操作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。