arXiv:2601.13250cs.RO2026-01

用扩散模型建模触觉传感器,实现无视觉下的物体姿态估计。

Diffusion-based Inverse Model of a Distributed Tactile Sensor for Object Pose Estimation

  • 用去噪扩散模型学习触觉逆模型,从触觉信号推断物体姿态。
  • 在仿真与真实场景中实现无视觉、无初始姿态先验的平面姿态估计。
  • 结合粒子滤波提升采样效率,适合触觉感知受限的机器人操作任务。

触觉感知在视觉受遮挡或环境干扰时,为物体姿态估计提供了有前景的传感方式。然而,由于观测不完整,单次触觉观测可能对应多种接触配置,使得传统视觉导向的估计方法难以有效应用。为此,我们提出基于去噪扩散模型学习逆触觉传感器模型,该模型以分布式触觉传感器的观测为条件,通过基于有符号距离场的几何传感器模型在仿真中训练。推理时,利用有符号距离场的距离与梯度信息进行单步投影,施加接触约束。在线姿态估计中,将逆模型与粒子滤波结合,通过融合生成假设与先验粒子的提议机制实现状态更新。方法在仿真和真实世界的平面姿态估计任务中验证,无需视觉数据或精确初始姿态先验。进一步在盒式推动场景中评估了对未建模接触与传感器动态的鲁棒性。相比局部采样基线,逆传感器模型提升了采样效率与估计精度,并在不同触觉可区分性的物体上保持多模态信念。

原文摘要 · Abstract (English)

Tactile sensing provides a promising sensing modality for object pose estimation in manipulation settings where visual information is limited due to occlusion or environmental effects. However, efficiently leveraging tactile data for estimation remains a challenge due to partial observability, with single observations corresponding to multiple possible contact configurations. This limits conventional estimation approaches largely tailored to vision. We propose to address these challenges by learning an inverse tactile sensor model using denoising diffusion. The model is conditioned on tactile observations from a distributed tactile sensor and trained in simulation using a geometric sensor model based on signed distance fields. Contact constraints are enforced during inference through single-step projection using distance and gradient information from the signed distance field. For online pose estimation, we integrate the inverse model with a particle filter through a proposal scheme that combines generated hypotheses with particles from the prior belief. Our approach is validated in simulated and real-world planar pose estimation settings, without access to visual data or tight initial pose priors. We further evaluate robustness to unmodeled contact and sensor dynamics for pose tracking in a box-pushing scenario. Compared to local sampling baselines, the inverse sensor model improves sampling efficiency and estimation accuracy while preserving multimodal beliefs across objects with varying tactile discriminability.

触觉感知姿态估计扩散模型机器人操作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。