arXiv:2509.10063cs.ROcs.AI2025-09被引 4

TwinTac让触觉传感器能用仿真数据训练机器人,提升感知能力。

TwinTac: A Wide-Range, Highly Sensitive Tactile Sensor with Real-to-Sim Digital Twin Sensor Model

  • 设计高灵敏度宽范围触觉传感器,配合真实到仿真数字孪生建模。
  • 数字孪生模型在物体分类任务中提升准确率,实现真实与仿真数据互补。
  • 适合需要触觉感知的机器人技能学习与跨域强化学习研究者。

基于强化学习的机器人技能获取常依赖仿真生成大规模交互数据,但触觉传感器缺乏仿真模型,限制了触觉驱动策略的发展。为此,我们提出TwinTac系统,将物理触觉传感器与数字孪生模型结合。硬件传感器具备高灵敏度和宽测量范围,可捕获高质量交互数据。基于此,采用真实到仿真的方法构建数字孪生模型:通过同步采集有限元模拟结果与真实传感器输出,训练神经网络实现从仿真数据到真实响应的映射。实验验证了物理传感器的敏感性,并证明数字孪生能一致复现真实输出。进一步在物体分类任务中,使用数字孪生生成的仿真数据显著增强真实数据,提升了分类准确率。结果表明TwinTac有望弥合跨域学习中的数据鸿沟。

原文摘要 · Abstract (English)

Robot skill acquisition processes driven by reinforcement learning often rely on simulations to efficiently generate large-scale interaction data. However, the absence of simulation models for tactile sensors has hindered the use of tactile sensing in such skill learning processes, limiting the development of effective policies driven by tactile perception. To bridge this gap, we present TwinTac, a system that combines the design of a physical tactile sensor with its digital twin model. Our hardware sensor is designed for high sensitivity and a wide measurement range, enabling high quality sensing data essential for object interaction tasks. Building upon the hardware sensor, we develop the digital twin model using a real-to-sim approach. This involves collecting synchronized cross-domain data, including finite element method results and the physical sensor's outputs, and then training neural networks to map simulated data to real sensor responses. Through experimental evaluation, we characterized the sensitivity of the physical sensor and demonstrated the consistency of the digital twin in replicating the physical sensor's output. Furthermore, by conducting an object classification task, we showed that simulation data generated by our digital twin sensor can effectively augment real-world data, leading to improved accuracy. These results highlight TwinTac's potential to bridge the gap in cross-domain learning tasks.

触觉传感数字孪生机器人学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。