arXiv:2601.09988cs.RO2026-01被引 33

用可穿戴传感器实现指尖级力控,让机器人更安全地完成精细操作。

In-the-Wild Compliant Manipulation with UMI-FT

  • 在每根手指装六轴力传感器,实时采集力矩与视觉信息
  • 训练出能调节位置、抓握力和刚度的自适应力控策略
  • 在擦黑板等任务中表现优于无力感基线,适合力控研究者

许多操作任务需要精确的力调节。力不足会导致失败,力过大可能造成损坏。商用力/力矩(F/T)传感器成本高、体积大且易损,限制了大规模力感知策略的学习。我们提出 UMI-FT,一种手持式数据采集平台,在每根手指上安装紧凑型六轴力/力矩传感器,实现指尖级的力矩测量,同时同步获取RGB、深度和位姿信息。利用该设备收集的多模态数据,我们训练了一个自适应合规策略,可预测执行位置目标、抓握力和刚度,用于标准合规控制器。在三个接触密集、力敏感的任务(擦白板、穿西葫芦、拧灯泡)中,UMI-FT使策略能够可靠调节外部接触力和内部抓握力,优于缺乏合规性或力感知的基线方法。UMI-FT为从真实场景演示中学习合规操作提供了可扩展路径。硬件与软件已开源:https://umi-ft.github.io/

原文摘要 · Abstract (English)

Many manipulation tasks require careful force modulation. With insufficient force the task may fail, while excessive force could cause damage. The high cost, bulky size and fragility of commercial force/torque (F/T) sensors have limited large-scale, force-aware policy learning. We introduce UMI-FT, a handheld data-collection platform that mounts compact, six-axis force/torque sensors on each finger, enabling finger-level wrench measurements alongside RGB, depth, and pose. Using the multimodal data collected from this device, we train an adaptive compliance policy that predicts position targets, grasp force, and stiffness for execution on standard compliance controllers. In evaluations on three contact-rich, force-sensitive tasks (whiteboard wiping, skewering zucchini, and lightbulb insertion), UMI-FT enables policies that reliably regulate external contact forces and internal grasp forces, outperforming baselines that lack compliance or force sensing. UMI-FT offers a scalable path to learning compliant manipulation from in-the-wild demonstrations. We open-source the hardware and software to facilitate broader adoption at:https://umi-ft.github.io/.

力控机器人多模态开源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。