MagicGripper融合触觉、视觉与距离感知,提升机器人抓取的精度与适应性。
MagicGripper: A Multimodal Sensor-Integrated Gripper for Contact-Rich Robotic Manipulation
- 将多层网格触觉传感器嵌入软胶,实现高分辨率触觉反馈。
- 在真实环境中验证,可精准定位接触点并估计受力大小。
- 适合需要精细操作的复杂抓取任务,如装配与对齐。
在非结构化环境中进行接触丰富的操作,需要精确的多模态感知以实现鲁棒且自适应的控制。基于视觉的触觉传感器(VBTS)已成为有效解决方案,但传统VBTS常因硬件限制和算法复杂性难以实现紧凑且多功能集成。本文提出MagicGripper,一种面向接触丰富操作的多模态传感夹持器。基于前期设计MagicTac,我们开发了紧凑型版本mini-MagicTac,其三维多层网格嵌入软弹性体中。MagicGripper集成了mini-MagicTac,实现了高分辨率触觉反馈,同时具备距离与视觉感知能力,整体结构紧凑,适配夹持器使用。我们全面评估了mini-MagicTac的性能,展示了其在空间分辨率、接触定位与力回归方面的表现。同时测试了其在制造差异、机械变形及实际工况下的鲁棒性。此外,通过三个典型任务验证:远程操作装配、基于接触的对齐以及自主抓取任务。实验表明,MagicGripper展现出可靠的多模态感知、精确的力估计,并对复杂操作场景具有高度适应性。结果凸显其在复杂接触环境中作为具身智能实用工具的潜力。
原文摘要 · Abstract (English)
Contact-rich manipulation in unstructured environments demands precise, multimodal perception to enable robust and adaptive control. Vision-based tactile sensors (VBTSs) have emerged as an effective solution; however, conventional VBTSs often face challenges in achieving compact, multi-modal functionality due to hardware constraints and algorithmic complexity. In this work, we present MagicGripper, a multimodal sensor-integrated gripper designed for contact-rich robotic manipulation. Building on our prior design, MagicTac, we develop a compact variant, mini-MagicTac, which features a three-dimensional, multi-layered grid embedded in a soft elastomer. MagicGripper integrates mini-MagicTac, enabling high-resolution tactile feedback alongside proximity and visual sensing within a compact, gripper-compatible form factor. We conduct a thorough evaluation of mini-MagicTac's performance, demonstrating its capabilities in spatial resolution, contact localization, and force regression. We also assess its robustness across manufacturing variability, mechanical deformation, and sensing performance under real-world conditions. Furthermore, we validate the effectiveness of MagicGripper through three representative robotic tasks: a teleoperated assembly task, a contact-based alignment task, and an autonomous robotic grasping task. Across these experiments, MagicGripper exhibits reliable multimodal perception, accurate force estimation, and high adaptability to challenging manipulation scenarios. Our results highlight the potential of MagicGripper as a practical and versatile tool for embodied intelligence in complex, contact-rich environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。