arXiv:2608.01824cs.RO2026-08被引 1

ReTouch让机器人通过实时触觉反馈优化操作,提升复杂抓握的稳定性。

ReTouch: Empowering Contact-Rich Dexterous Manipulation with Online-Refined Tactile Prediction

论文配图:ReTouch: Empowering Contact-Rich Dexterous Manipulation with Online-Refined Tactile Prediction
图 1 · 摘自论文原文
  • 用触觉图块编码器保留手指身份和接触结构,支持精细控制。
  • 执行中持续用触觉反馈修正动作与预测,成功率比基线高18.4%~23.8%。
  • 适合需要高精度触觉交互的机器人操作任务,如灵巧抓握。

融合触觉信号在接触丰富的操作中已被证明有效,使机器人能够感知接触状态并适应快速变化的物理交互。然而,如何将触觉反馈有效整合到灵巧操作中仍待探索。本文提出ReTouch,一种视觉-语言-动作模型(VLA),通过执行时反馈在线持续优化触觉预测,实现接触丰富的灵巧操作。ReTouch的核心创新包括:其一,触觉图块编码器将触觉观测表示为保持手指身份和局部接触结构的结构化特征,提供细粒度控制线索;其二,高频动作模块联合预测未来触觉状态与动作片段,并在执行中利用实时触觉反馈同步修正两者。该闭环优化使触觉预测始终与动态物理交互对齐,实现响应式动作修正,提升对接触变化和执行误差的鲁棒性。我们还构建了XHT-Dataset,包含在XHand–UR7e平台收集的7个接触丰富任务的900个真实演示数据,并通过闭环真实机器人实验评估。ReTouch在标准与挑战条件下平均成功率分别优于最强基线18.4和23.8个百分点,验证了其有效性与鲁棒性。

原文摘要 · Abstract (English)

Fusing tactile signals has proven effective for contact-rich manipulation, enabling robots to perceive contact states and adapt to rapidly changing physical interactions. Yet effectively integrating tactile feedback into dexterous manipulation remains underexplored. In this work, we introduce ReTouch, a vision-language-action model (VLA) that supports contact-rich dexterous manipulation through tactile predictions continually refined online using execution-time feedback. ReTouch builds on two main innovations for tactile representation and closed-loop action generation. First, its Tactile-Patch Encoder represents tactile observations as structured tactile patch features that preserve finger identity and local contact structure, providing contact cues for fine-grained dexterous control. Second, its high-frequency action module jointly predicts future tactile states and action chunks and refines both using incoming tactile feedback during execution. This closed-loop refinement keeps tactile predictions aligned with evolving physical interactions, enabling responsive action correction and improving robustness to contact changes and execution errors. We further introduce XHT-Dataset, comprising 900 real-world demonstrations across seven contact-rich tasks collected on an XHand--UR7e platform, and evaluate ReTouch through closed-loop real-robot experiments. ReTouch surpasses the strongest baseline by 18.4 and 23.8 percentage points in average success rate under standard and challenging conditions, respectively, demonstrating its effectiveness and robustness.

灵巧操作触觉反馈闭环控制机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。