arXiv:2503.02881cs.ROcs.AI2025-03中稿 · RSS 2025被引 192

提出慢快双层触觉-视觉策略,让机器人像人一样实时反应接触变化。

Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulation

  • 慢层用扩散模型预测高层动作块,快层通过触觉反馈实时调整
  • 在3个高难度接触任务中性能超越现有视觉模仿学习方法
  • 适配多种触觉传感器,低成本系统实现真实触觉远程操作

人类能借助视觉和触觉完成复杂的接触密集型任务,具备快速响应外部变化和自适应接触力的能力;但机器人仍面临挑战。现有视觉模仿学习方法依赖动作分块建模复杂行为,无法在分块执行期间即时响应实时触觉反馈。此外,多数遥操作系统的触觉/力反馈精细度不足,限制了可执行任务范围。为此,我们提出TactAR——一个低成本的遥操作系统,通过增强现实(AR)提供实时触觉反馈,并引入反应式扩散策略(RDP),一种新型的慢-快双层视觉-触觉模仿学习算法,用于学习接触密集型操作技能。RDP采用两级架构:(1) 慢速潜在扩散策略,在低频下于潜在空间预测高层动作块;(2) 快速非对称分词器,以高频进行闭环触觉反馈控制。该设计使统一框架内兼具复杂轨迹建模与快速反应能力。在三个具有挑战性的接触密集型任务上广泛评估显示,相比最先进视觉模仿学习基线,RDP显著提升性能。实验还表明RDP可适用于不同触觉/力传感器。代码与视频见 https://reactive-diffusion-policy.github.io。

原文摘要 · Abstract (English)

Humans can accomplish complex contact-rich tasks using vision and touch, with highly reactive capabilities such as fast response to external changes and adaptive control of contact forces; however, this remains challenging for robots. Existing visual imitation learning (IL) approaches rely on action chunking to model complex behaviors, which lacks the ability to respond instantly to real-time tactile feedback during the chunk execution. Furthermore, most teleoperation systems struggle to provide fine-grained tactile / force feedback, which limits the range of tasks that can be performed. To address these challenges, we introduce TactAR, a low-cost teleoperation system that provides real-time tactile feedback through Augmented Reality (AR), along with Reactive Diffusion Policy (RDP), a novel slow-fast visual-tactile imitation learning algorithm for learning contact-rich manipulation skills. RDP employs a two-level hierarchy: (1) a slow latent diffusion policy for predicting high-level action chunks in latent space at low frequency, (2) a fast asymmetric tokenizer for closed-loop tactile feedback control at high frequency. This design enables both complex trajectory modeling and quick reactive behavior within a unified framework. Through extensive evaluation across three challenging contact-rich tasks, RDP significantly improves performance compared to state-of-the-art visual IL baselines. Furthermore, experiments show that RDP is applicable across different tactile / force sensors. Code and videos are available on https://reactive-diffusion-policy.github.io.

触觉控制扩散模型模仿学习机器人操作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。