arXiv:2512.00324cs.ROcs.CV2025-12被引 5

MILE系统同步采集人手动作与触觉数据,助力精细操作技能学习。

MILE: A Mechanically Isomorphic Hand Exoskeleton and Visuotactile Robotic Hand for Data Collection in Dexterous Manipulation

  • 基于人体解剖设计可穿戴外骨骼,匹配机械结构的机器人手实现精准动作传递。
  • 同步记录四指触觉、视觉、本体感知与动作指令,支持高保真数据采集。
  • 适合需要触觉反馈的灵巧操作研究,尤其在模仿学习中提升模型性能。

灵巧机器人手需完成复杂、接触密集的物体操作,但学习此类技能仍具挑战,因高维手部需高保真示范。模仿学习可通过人类示范获取灵巧操作技能,但同步采集准确手部动作与触觉观测仍为关键瓶颈。本文提出MILE,一个基于遥操作的数据采集系统,包含以人类为中心的MILE外骨骼和机械对应的MILE-Tac机器人手。系统集成自研模块化关节编码器与紧凑型指尖视觉-触觉传感器模块。外骨骼基于人手解剖与人体工学设计,机器人手则共设计以保留选定的四指运动学拓扑。该对应性实现关节空间指令传输,减少对任务空间逆运动学重映射的依赖。系统同步记录特定任务的视觉观测、四个指尖的视觉-触觉流、机器人手本体感知及外骨骼生成的动作指令。我们在四项任务的遥操作基准测试中,对比了代表性手套式与视觉式接口,并通过模仿学习实验比较了有无指尖触觉输入训练的策略。项目主页见 https://sites.google.com/view/mile-system。

原文摘要 · Abstract (English)

Dexterous robotic hands are expected to perform complex, contact-rich object manipulation, but learning such skills remains challenging because high-dimensional hands require high-fidelity demonstrations. Imitation learning provides a practical route for acquiring dexterous manipulation skills from human demonstrations, yet collecting synchronized multimodal demonstrations with accurate hand actions and tactile observations remains a key bottleneck. We present MILE, a teleoperation-based data-collection system comprising the human-first MILE exoskeleton and the mechanically corresponding MILE-Tac robotic hand. The system integrates custom-designed and fabricated modular joint encoders and compact MILE fingertip visuotactile sensor modules. The exoskeleton is informed by human-hand anatomy and ergonomic constraints, while the robotic hand is co-designed to preserve the selected four-finger kinematic topology. This correspondence enables joint-space command transfer and reduces reliance on task-space IK-based retargeting. The system synchronously records task-specific visual observations, four fingertip visuotactile streams, robot-hand proprioception, and exoskeleton-derived action commands. We evaluate MILE through a four-task teleoperation benchmark against representative glove-based and vision-based interfaces, and through imitation-learning experiments that compare policies trained with and without fingertip tactile input. The project page is available at https://sites.google.com/view/mile-system.

灵巧操作触觉感知数据采集外骨骼

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。