用触觉传感实现无视觉的精准机械臂远程操作
Leveraging Tactile Sensing to Render both Haptic Feedback and Virtual Reality 3D Object Reconstruction in Robotic Telemanipulation
- 通过触觉传感器重建3D物体，替代摄像头进行远程操控
- 盲眼用户也能完成抓取放置任务，成功率显著提升
- 适合光照差或遮挡场景，拓展机器人遥操作应用边界
灵巧机械臂的远程操作广泛应用于需要人类在控制回路中干预，或训练先进机器人代理的场景。目前该技术主要依赖相机系统并取得显著成效。然而，针对相机系统失效（如自遮挡、烟雾等光照不良条件）时，利用触觉反馈的研究仍十分有限。本研究展示了仅依靠触觉传感实现精确抓取与放置操作的可行性：在虚拟现实中基于触觉数据重建3D物体，并向蒙眼用户实时提供触觉反馈。初步结果表明，该方法可成功完成以往依赖摄像头才能完成的遥操作任务，为未来更复杂的应用铺平道路。
原文摘要 · Abstract (English)
Dexterous robotic manipulator teleoperation is widely used in many applications, either where it is convenient to keep the human inside the control loop, or to train advanced robot agents. So far, this technology has been used in combination with camera systems with remarkable success. On the other hand, only a limited number of studies have focused on leveraging haptic feedback from tactile sensors in contexts where camera-based systems fail, such as due to self-occlusions or poor light conditions like smoke. This study demonstrates the feasibility of precise pick-and-place teleoperation without cameras by leveraging tactile-based 3D object reconstruction in VR and providing haptic feedback to a blindfolded user. Our preliminary results show that integrating these technologies enables the successful completion of telemanipulation tasks previously dependent on cameras, paving the way for more complex future applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。