用触觉信号让机器人像人一样精准抓握物体
TactiDex: A Real-World Tactile-Guided Benchmark for Human-Like Dexterous Manipulation

- 用全手触觉信号对齐动作与物体状态,实现接触级模仿
- 新框架在单手和双手任务中成功率显著提升
- 适合研究触觉感知与灵巧操作的学者参考
触觉反馈是人机交互中接触形成、力控与稳定操作的核心,对实现真正类人灵巧操作至关重要。然而当前的人机灵巧操作迁移方法主要依赖运动轨迹,仅实现动作模仿而缺乏物理交互。为此,我们提出 TactiDex,一个面向真实世界的触觉引导基准,旨在推动灵巧操作从运动轨迹模仿迈向接触级类人水平。TactiDex 提供了一个全面的数据集,将全手触觉信号与多粒度运动学及物体状态对齐,并配备标准化评估指标。基于此数据范式,我们提出一种触觉驱动的迁移框架,可将人类示范转化为物理合理的机器人执行。我们引入 TactiSkill 框架,其采用新颖的三组件触觉奖励机制,创新性地利用触觉信号作为结构化监督,统一指导、类人对齐与接触约束于单一目标。在单手与双手任务上的综合实验表明,TactiSkill 在操作成功性和物理真实性方面均表现优异。本工作为推进触觉感知的灵巧操作奠定了关键基础。
原文摘要 · Abstract (English)
Tactile feedback is fundamental to Hand-Object Interaction (HOI), governing contact formation, force regulation, and stable manipulation, making it essential for achieving true human-like dexterous manipulation. Yet, current human-to-robot dexterous transfer pipelines primarily rely on kinematic trajectories, resulting in motion imitation without physically grounded interaction. To address this, we introduce TactiDex, a real-world tactile-guided benchmark specifically designed to move dexterous manipulation beyond kinematic mimicry toward contact-level human-likeness. TactiDex provides a comprehensive dataset that elegantly aligns whole-hand tactile signals with multi-granularity kinematic and object states, coupled with standardized evaluation metrics. Building upon this data paradigm, we propose a tactile-driven transfer framework that effectively translates human demonstrations into physically plausible robotic execution. We introduce TactiSkill, a framework built upon a novel tri-component tactile reward that innovatively uses tactile signals as structured supervision. This reward unifies guidance, human-like alignment, and contact constraints into a single objective. Through comprehensive experiments on both single and bimanual tasks, we demonstrate that TactiSkill achieves superior performance in manipulation success and physical realism. This work lays a crucial foundation for advancing tactile-aware dexterous manipulation. Our project page at https://tactidex.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。