arXiv:2605.28812cs.ROcs.AI2026-05被引 1

用物理原理的触觉表征实现无需标注的高精度仿真实现抓取

Beyond Binary: Sim-to-Real Dexterous Manipulation with Physics-Grounded Contact Representation

论文配图:Beyond Binary: Sim-to-Real Dexterous Manipulation with Physics-Grounded Contact Representation
图 1 · 摘自论文原文
  • 提出基于物理的接触中心(CoP)表征,保留密集触觉信息
  • 在插销和球平衡任务中实现零样本仿真到现实迁移
  • 适合需要精细触觉反馈的复杂操作研究者

接触丰富型操作的主要瓶颈在于真实世界数据收集困难。仿真到现实的强化学习提供了可扩展的替代方案,但仿真与现实之间的差距限制了触觉等信息密集模态的有效使用。现有方法常将触觉数据简化为粗糙的低维特征,牺牲了复杂操作所需的丰富性。本文提出中心接触点(CoP),一种基于物理原理的触觉表示,可在保持仿真到现实迁移鲁棒性的同时,保留密集接触信息。为此,我们设计了一种基于可微分动力学的传感器校准方案,无需真实力测量即可估计触点方向。我们在两个盲视、高难度的接触丰富操作任务(插销入孔与球平衡)上评估了CoP。结果表明,基于CoP的策略在多指机械手上实现了零样本仿真到现实迁移,并优于粗略二值接触和原始触点基线。对学习策略状态的分析进一步表明,CoP条件策略能以控制过程的副产物形式编码物体质量等任务相关物理属性。

原文摘要 · Abstract (English)

A primary bottleneck in contact-rich manipulation is the difficulty of collecting real-world data. Sim-to-real reinforcement learning offers a scalable alternative, but the simulation-reality gap prevents information-dense modalities like touch from being effectively used. Existing sim-to-real methods often mitigate this gap by simplifying tactile data into coarse low-dimensional features -- sacrificing the richness required for complex manipulation. In this work, we introduce Center-of-Pressure (CoP), an effective tactile representation grounded in physical principles that preserves dense contact information while maintaining robustness for sim-to-real transfer. To support this representation, we propose a sensor calibration scheme based on differentiable dynamics, enabling the estimation of taxel orientations without requiring ground-truth force measurements. We evaluate CoP on two blind, challenging contact-rich manipulation tasks: peg-in-hole insertion and ball balancing. Across both tasks, policies conditioned on CoP achieve zero-shot sim-to-real transfer on a multi-fingered hand, and outperform both coarse binary-contact and raw-taxel baselines. Analysis of learned policy states further suggests that CoP-conditioned policies encode task-relevant physical properties, such as object mass, as an emergent byproduct of control.

触觉感知仿真实现机械手强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。