用深度图统一模拟与现实,让机器人触觉更真实。
Tacmap: Bridging the Tactile Sim-to-Real Gap via Geometry-Consistent Penetration Depth Map
- 用体积穿透深度图统一模拟与真实触觉数据
- 在多种接触场景中,模拟结果与真实测量高度一致
- 纯仿真训练的策略可零样本迁移到真实机器人
基于视觉的触觉传感器(VBTS)对实现灵巧机器人操作至关重要,但触觉模拟到现实的差距仍是核心瓶颈。当前触觉模拟面临两难:简化的几何投影缺乏物理真实性,而高保真的有限元方法(FEM)计算成本过高,难以支持大规模强化学习。本文提出Tacmap,一种高保真且计算高效的触觉模拟框架,基于体素穿透深度构建。关键洞察是通过共享的形变图表示统一两个领域:在模拟中计算3D交集体积作为深度图,在真实世界中通过自动化数据采集装置从原始触觉图像学习到真实深度图的鲁棒映射。通过在统一的几何空间中对齐模拟与真实,Tacmap有效减小域偏移并保持物理一致性。定量评估显示,Tacmap生成的形变图在多种接触场景下与真实测量高度吻合。进一步验证表明,仅在仿真中训练的策略可零样本迁移至物理机器人完成抓取旋转任务。
原文摘要 · Abstract (English)
Vision-Based Tactile Sensors (VBTS) are essential for achieving dexterous robotic manipulation, yet the tactile sim-to-real gap remains a fundamental bottleneck. Current tactile simulations suffer from a persistent dilemma: simplified geometric projections lack physical authenticity, while high-fidelity Finite Element Methods (FEM) are too computationally prohibitive for large-scale reinforcement learning. In this work, we present Tacmap, a high-fidelity, computationally efficient tactile simulation framework anchored in volumetric penetration depth. Our key insight is to bridge the tactile sim-to-real gap by unifying both domains through a shared deform map representation. Specifically, we compute 3D intersection volumes as depth maps in simulation, while in the real world, we employ an automated data-collection rig to learn a robust mapping from raw tactile images to ground-truth depth maps. By aligning simulation and real-world in this unified geometric space, Tacmap minimizes domain shift while maintaining physical consistency. Quantitative evaluations across diverse contact scenarios demonstrate that Tacmap's deform maps closely mirror real-world measurements. Moreover, we validate the utility of Tacmap through an in-hand rotation task, where a policy trained exclusively in simulation achieves zero-shot transfer to a physical robot.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。