让机器人通过触觉感知精准控制抓握力度,提升操作脆弱物体的能力。
Tactile-Conditioned Diffusion Policy for Force-Aware Robotic Manipulation
- 用高维触觉数据生成力反馈信号,构建力驱动的动作空间。
- 在高低力及动态调力任务中均超越基线模型,成功率显著提升。
- 适合需要精细力控的机器人操作场景,如医疗或精密装配。
接触丰富的操作依赖在整个任务中施加正确的抓握力,尤其在处理易碎或可变形物体时。现有模仿学习方法通常将视觉-触觉反馈视为附加观测,使施加的力成为夹爪指令的未受控结果。本文提出力感知机器人操作框架FARM,通过高维触觉数据推断触觉条件下的力信号,并据此定义匹配的力基动作空间。我们使用集成GelSight Mini视觉触觉传感器的改良版手持通用操作接口(UMI)夹爪收集人类示范数据。为部署学习策略,开发了与手持版本几何匹配的电动化UMI夹爪。在策略执行中,提出的FARM扩散策略联合预测机器人位姿、夹持宽度和夹持力。FARM在三个具有不同力需求的任务——高力、低力及动态力适应——中均优于多个基线模型,验证了其两大核心优势:利用力锚定的高维触觉观测和力基控制空间。代码库与设计文件已开源,地址为 https://tactile-farm.github.io。
原文摘要 · Abstract (English)
Contact-rich manipulation depends on applying the correct grasp forces throughout the manipulation task, especially when handling fragile or deformable objects. Most existing imitation learning approaches often treat visuotactile feedback only as an additional observation, leaving applied forces as an uncontrolled consequence of gripper commands. In this work, we present Force-Aware Robotic Manipulation (FARM), an imitation learning framework that integrates high-dimensional tactile data to infer tactile-conditioned force signals, which in turn define a matching force-based action space. We collect human demonstrations using a modified version of the handheld Universal Manipulation Interface (UMI) gripper that integrates a GelSight Mini visual tactile sensor. For deploying the learned policies, we developed an actuated variant of the UMI gripper with geometry matching our handheld version. During policy rollouts, the proposed FARM diffusion policy jointly predicts robot pose, grip width, and grip force. FARM outperforms several baselines across three tasks with distinct force requirements -- high-force, low-force, and dynamic force adaptation -- demonstrating the advantages of its two key components: leveraging force-grounded, high-dimensional tactile observations and a force-based control space. The codebase and design files are open-sourced and available at https://tactile-farm.github.io .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。