arXiv:2509.25746cs.RO2025-09

用触觉精调抓取,让机械手稳抓薄板等易滑物体。

TacRefineNet: Goal-Conditioned Tactile Grasp Refinement for Edge-Prominent Objects

  • 仅靠触觉信号,通过迭代开合重抓实现精准抓取微调
  • 真实实验中固定目标成功率80.7%,五步后误差约5.2mm、3.5°
  • 无需重新训练即可适应不同目标位置,适合复杂形状物体

针对薄板、圆盘、细杆等边缘突出物体因接触稀疏导致深度感知易被遮挡的问题,本文提出纯触觉、目标条件化的局部抓取精调框架TacRefineNet。给定当前与目标的多指触觉图像及其对应关节状态,采用孪生策略网络直接预测修正手腕姿态增量。机械手反复开合、移动、重抓,形成外部灵巧的触觉伺服循环。通过交叉组合训练对,使目标可在采样姿态范围内任意指定而无需重新训练。在MuJoCo中采集156,007条来自15种物体的模拟数据,训练完后零样本部署至11自由度五指手(配备压阻式传感器)。在已见物体上,真实系统在10°/10mm标准下,固定目标成功率达80.7%,随机目标为59.3%;经过五步迭代后,平均误差约为5.2mm和3.5°。实验还验证了长时程扰动下的持续校正能力及有限类内迁移至未见物体的能力,对对称或弱区分性接触表现下降。

原文摘要 · Abstract (English)

Accurate final grasp alignment remains challenging for edge-prominent objects such as thin plates, discs, and rods, whose sparse contacts are easily occluded and poorly resolved by depth sensing. We present TacRefineNet, a tactile-only, goal-conditioned framework for local refinement along tactilely observable pose dimensions. Given current and target multi-finger tactile images and their corresponding hand-joint configurations, a Siamese policy network directly predicts corrective wrist pose increments. The hand iteratively opens, moves, and regrasps, forming an external-dexterity tactile servoing loop. Cross-combination training pairs current and target samples, allowing targets within the sampled pose range to be specified without retraining. We collect 156,007 simulated samples from 15 plates, discs, and rods and train the policy entirely in MuJoCo before zero-shot deployment to an 11-DoF five-fingered hand with piezoresistive sensors. On seen objects, the real system achieves 80.7\% and 59.3\% success under the $10^\circ$/10\,mm criterion for fixed and random targets, respectively; after five steps, the mean errors are approximately 5.2\,mm and $3.5^\circ$. Experiments further show continuous correction under long-horizon perturbations and limited within-category transfer to unseen objects, with reduced performance for symmetric or weakly discriminative contacts. Project website is available at https://sites.google.com/view/tacrefinenet

触觉控制抓取精调机械手多指操作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。