arXiv:2604.27224cs.RO2026-04被引 2

用触觉增强四足机器人抓取与移动协同能力,提升复杂接触任务表现。

Learning Tactile-Aware Quadrupedal Loco-Manipulation Policies

论文配图:Learning Tactile-Aware Quadrupedal Loco-Manipulation Policies
图 1 · 摘自论文原文
  • 分层架构:先用真人示范训练触觉感知的高层策略,再在仿真中强化全身控制。
  • 实测平均性能提升28.54%,在插入、拧阀、精细操作等任务中表现更优。
  • 适合需要高接触精度的机器人应用,如工业装配或危险环境作业。

四足运动-操作通常依赖视觉和本体感知,但高接触场景下的可靠操作仍具挑战:仅靠视觉与本体感知无法解决与环境交互中的不确定性。触觉感知可直接观测接触状态,但面向四足运动-操作的可扩展触觉感知学习框架尚未充分探索。本文提出一种分层触觉感知运动-操作策略学习流程。首先,利用真实世界的人类示范数据训练触觉条件化的视觉-触觉高层策略,该策略不仅能预测末端执行器轨迹,还能预测随时间演化的触觉交互线索。其次,在大规模仿真中通过强化学习训练触觉感知的全身控制策略,使其能追踪多种命令轨迹与触觉线索,并实现零样本迁移至真实世界。两者结合使系统在接触丰富的场景下实现运动与操作的协调。我们在真实世界中评估了多项接触密集型任务,包括物体内部翻转插入、阀门紧固及精细物体操作。相比纯视觉与视觉-触觉基线方法,本方法在这些任务上平均性能提升28.54%。

原文摘要 · Abstract (English)

Quadrupedal loco-manipulation is commonly built on visual perception and proprioception. Yet reliable contact-rich manipulation remains difficult: vision and proprioception alone cannot resolve uncertain, evolving interactions with the environment. Tactile sensing offers direct contact observability, but scalable tactile-aware learning framework for quadrupedal loco-manipulation is still underexplored. In this paper, we present a tactile-aware loco-manipulation policy learning pipeline with a hierarchical structure. Our approach has two key components. First, we leverage real-world human demonstrations to train a tactile-conditioned visuotactile high-level policy. This policy predicts not only end-effector trajectories for manipulation, but also the evolving tactile interaction cues that characterize how contact should develop over time. Second, we perform large-scale reinforcement learning in simulation to learn a tactile-aware whole-body control policy that tracks diverse commanded trajectories and tactile interaction cues, and transfers zero-shot to the real world. Together, these components enable coordinated locomotion and manipulation under contact-rich scenarios. We evaluate the system on real-world contact-rich tasks, including in-hand reorientation with insertion, valve tightening, and delicate object manipulation. Compared to vision-only and visuotactile baselines, our method improves performance by 28.54% on average across these tasks.

四足机器人触觉感知运动操作强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。