arXiv:2504.00167cs.RO2025-04被引 2

用机器人自带触觉传感器识别手指画数字,准确率达94%

Enhancing Physical Human-Robot Interaction: Recognizing Digits via Intrinsic Robot Tactile Sensing

  • 利用机器人关节扭矩信号捕捉手写数字的触觉特征
  • 在多种测试场景下实现94%的在线识别准确率
  • 无需额外传感器,适合残障人士辅助生活应用

物理人机交互(pHRI)是实现机器人自然、安全交互的关键挑战。现有方法多依赖外部触觉传感器,增加系统复杂性。本研究利用协作机器人自身的触觉感知能力,通过安装在机械臂末端的无传感触摸板,识别用户手写数字(0-9)。我们构建了pHRI-DIGI-TACT数据集,包含来自不同用户的关节扭矩、末端执行器力与力矩信号,反映自然书写差异。为提升分类鲁棒性,提出一种数据增强方法,处理反转与旋转输入。采用双向长短期记忆网络(Bi-LSTM),基于数据时空特性实现在线数字识别,整体准确率达94%,涵盖未参与训练的用户测试场景。该方法已在真实机器人上实现水果递送任务演示,展现其在日常生活辅助中的潜力。数据集与视频展示见:https://TS-Robotics.github.io/pHRI-DIGI/

原文摘要 · Abstract (English)

Physical human-robot interaction (pHRI) remains a key challenge for achieving intuitive and safe interaction with robots. Current advancements often rely on external tactile sensors as interface, which increase the complexity of robotic systems. In this study, we leverage the intrinsic tactile sensing capabilities of collaborative robots to recognize digits drawn by humans on an uninstrumented touchpad mounted to the robot's flange. We propose a dataset of robot joint torque signals along with corresponding end-effector (EEF) forces and moments, captured from the robot's integrated torque sensors in each joint, as users draw handwritten digits (0-9) on the touchpad. The pHRI-DIGI-TACT dataset was collected from different users to capture natural variations in handwriting. To enhance classification robustness, we developed a data augmentation technique to account for reversed and rotated digits inputs. A Bidirectional Long Short-Term Memory (Bi-LSTM) network, leveraging the spatiotemporal nature of the data, performs online digit classification with an overall accuracy of 94\% across various test scenarios, including those involving users who did not participate in training the system. This methodology is implemented on a real robot in a fruit delivery task, demonstrating its potential to assist individuals in everyday life. Dataset and video demonstrations are available at: https://TS-Robotics.github.io/pHRI-DIGI/.

人机交互触觉感知数字识别机器人应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。