arXiv:2602.01153cs.RO2026-02被引 3

统一多种触觉传感器的力感知表示,实现零样本迁移。

UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors

  • 构建跨传感器的共享力空间,联合建模正反动力学
  • 无需外部力传感器,通过静态平衡采集配对数据
  • 支持多种传感器零样本适配,适合多模态机器人任务

力感知对灵巧机器人操作至关重要,但不同触觉传感器(如GelSight、TacTip、uSkin)在传感原理、外形和材料上的差异,导致需针对每种传感器单独采集数据、校准与训练,限制了泛化能力。本文提出UniForce,一种统一的触觉表征学习框架,通过联合建模逆动力学(图像到力)与正动力学(力到图像),结合力平衡与图像重建损失,学习跨传感器的共享潜空间。为避免依赖昂贵的外部力/扭矩(F/T)传感器,利用静态平衡特性,通过传感器-物体-传感器直接交互收集力配对数据,实现跨传感器力对齐。所获通用触觉编码器可直接用于下游力感知机器人操作任务,无需重训练或微调。在多种异构触觉传感器上进行的大量实验表明,其在力估计上优于现有方法,并成功支持视觉-触觉-语言-动作(VTLA)模型在机器人擦除任务中的跨传感器协同。代码与数据集将公开。

原文摘要 · Abstract (English)

Force sensing is essential for dexterous robot manipulation, but scaling force-aware policy learning is hindered by the heterogeneity of tactile sensors. Differences in sensing principles (e.g., optical vs. magnetic), form factors, and materials typically require sensor-specific data collection, calibration, and model training, thereby limiting generalisability. We propose UniForce, a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors. UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image), constrained by force equilibrium and image reconstruction losses to produce force-grounded representations. To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions, enabling cross-sensor alignment with contact force. The resulting universal tactile encoder can be plugged into downstream force-aware robot manipulation tasks with zero-shot transfer, without retraining or finetuning. Extensive experiments on heterogeneous tactile sensors including GelSight, TacTip, and uSkin, demonstrate consistent improvements in force estimation over prior methods, and enable effective cross-sensor coordination in Vision-Tactile-Language-Action (VTLA) models for a robotic wiping task. Code and datasets will be released.

触觉感知机器人操控多传感器融合零样本迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。