用物理模型精准模拟触觉传感器受力,提升机器人学习的可靠性。
TaCauchy: An Extensible FEM Framework for Vision-Based Tactile Simulation

- 基于有限元法直接计算应力张量,避免经验估算
- 单环境33.4帧,60个并行环境总吞吐555帧,耗时<1毫秒
- 适配多种触觉传感器,物理验证误差小,适合机器人操控训练
基于视觉的触觉传感器需要高保真仿真以支持强化学习,但现有方法难以在GPU加速的机器人平台中准确生成力学应力场。本文提出TaCauchy,一个可扩展的有限元法(FEM)框架,集成于Isaac Sim。基于统一增量势接触(UIPC)求解器,该框架从超弹性本构关系直接计算柯西应力张量,并投影至接触面获得牵引力与压强分布,实现从物理原理出发的力学真实数据,而非经验估计。框架支持几何感知的自适应网格自动生成功能,以及模块化传感器接口,可快速集成GelSight Mini、DIGIT、9DTact等多种传感器,配置极少。性能测试显示:单环境达33.40 FPS,60个并行环境总吞吐量555 FPS,应力提取延迟低于1毫秒。物理验证实验表明,模拟与真实触觉响应在1.2556 N至4.7332 N力范围内高度一致,结构相似性(SSIM)超过0.93,证实其可为下游机器人操作任务提供准确的物理引导。
原文摘要 · Abstract (English)
Vision-based tactile sensors require high-fidelity simulation for reinforcement learning, yet existing approaches struggle to provide accurate mechanical stress fields within GPU-accelerated robotics platforms. We present TaCauchy, an extensible Finite Element Method (FEM) framework that integrates rigorous physics-based force computation into Isaac Sim. Built on the Unified Incremental Potential Contact (UIPC) solver, TaCauchy directly computes Cauchy stress tensors from hyperelastic constitutive laws and projects them onto contact surfaces to obtain traction forces and pressure distributions, providing mechanical ground truth from first principles rather than empirical estimation. Our framework features automatic mesh generation with geometry-aware adaptive refinement and a modular sensor interface enabling rapid integration of diverse sensors (GelSight Mini, DIGIT, 9DTact) with minimal configuration. Performance benchmarks demonstrate 33.40 FPS for single environments and 555 FPS aggregate throughput across 60 parallel environments, with stress extraction overhead under 1 ms. Physical validation experiments show strong agreement between simulated and real tactile responses across force ranges from 1.2556 N to 4.7332 N, achieving SSIM above 0.93, confirming the framework's capability to provide accurate, physically-grounded force supervision for downstream robotic manipulation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。