arXiv:2602.10093cs.RO2026-02被引 21

构建统一仿真平台,生成触觉视觉数据提升机器人操作性能

UniVTAC: A Unified Simulation Platform for Visuo-Tactile Manipulation Data Generation, Learning, and Benchmarking

  • 基于仿真生成触觉视觉数据,支持三种主流传感器
  • 使用合成数据训练编码器,使任务成功率平均提升17.1%
  • 提供八项真实任务基准,适合研究触觉驱动策略的学者

机器人操作在视觉-语言-动作(VLA)策略推动下快速发展,但接触密集型任务如插入仍需依赖触觉感知。然而,真实世界中大规模可靠触觉数据获取成本高,且缺乏统一评估平台,制约了策略学习与系统分析。为此,我们提出UniVTAC——一个基于仿真的触觉视觉数据合成平台,支持三种常用触觉传感器,可规模化、可控地生成富有信息量的接触交互数据。基于该平台,我们设计了UniVTAC Encoder,利用大规模仿真合成数据与定制监督信号训练,提供以触觉为中心的多模态表征,用于下游操作任务。此外,我们构建了包含八类代表性任务的UniVTAC Benchmark,用于评估触觉驱动策略。实验表明,集成UniVTAC Encoder后,在基准上平均成功率提升17.1%;真实机器人实验进一步验证了25%的任务成功率提升。

原文摘要 · Abstract (English)

Robotic manipulation has seen rapid progress with vision-language-action (VLA) policies. However, visuo-tactile perception is critical for contact-rich manipulation, as tasks such as insertion are difficult to complete robustly using vision alone. At the same time, acquiring large-scale and reliable tactile data in the physical world remains costly and challenging, and the lack of a unified evaluation platform further limits policy learning and systematic analysis. To address these challenges, we propose UniVTAC, a simulation-based visuo-tactile data synthesis platform that supports three commonly used visuo-tactile sensors and enables scalable and controllable generation of informative contact interactions. Based on this platform, we introduce the UniVTAC Encoder, a visuo-tactile encoder trained on large-scale simulation-synthesized data with designed supervisory signals, providing tactile-centric visuo-tactile representations for downstream manipulation tasks. In addition, we present the UniVTAC Benchmark, which consists of eight representative visuo-tactile manipulation tasks for evaluating tactile-driven policies. Experimental results show that integrating the UniVTAC Encoder improves average success rates by 17.1% on the UniVTAC Benchmark, while real-world robotic experiments further demonstrate a 25% improvement in task success. Our webpage is available at https://univtac.github.io/.

机器人操作触觉感知仿真平台多模态学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。