arXiv:2602.09888cs.RO2026-02被引 7

用脚踏板+力反馈实现机器人全身远程操作,防碰撞更智能。

TriPilot-FF: Coordinated Whole-Body Teleoperation with Force Feedback

  • 脚踏板结合激光雷达生成阻力反馈,自动避障
  • 双臂协同操作,实时显示力与可操作性引导移动
  • 适合需要长时间精确移动的工业或救援场景

移动机械臂扩展了机器人的操作范围。然而,这类机器人的全身远程操作仍具挑战:操作者需协调轮式底盘和双臂,同时感知障碍物与接触。现有接口多以手部为中心(如VR控制器、摇杆),足部控制通道未被充分探索。本文提出TriPilot-FF,一个开源的全身远程操作系统,专为定制双臂移动机械臂设计,引入脚踏式踏板与激光雷达驱动的触觉反馈,配合上肢双臂主从操作。仅使用低成本底部安装激光雷达,系统根据命令方向的障碍物距离生成阻力提示,使操作行为自然规避碰撞,无需显式避障控制器。系统还支持臂侧力反馈以增强接触感知,并实时提供双臂可操作性力与视觉引导,促使底盘重新定位以提升可达性。我们展示了该系统在长时间任务中有效“协驾”人类操作者的能力,尤其适用于需精准底盘移动与协调的任务。最后,我们将远程操作反馈信号融入基于Transformer的动作分块策略(ACT),在信息可用时显著提升性能。项目发布踏板设计、完整软件栈,并在双臂轮式平台进行了大量真实世界评估。

原文摘要 · Abstract (English)

Mobile manipulators broaden the operational envelope for robot manipulation. However, the whole-body teleoperation of such robots remains a problem: operators must coordinate a wheeled base and two arms while reasoning about obstacles and contact. Existing interfaces are predominantly hand-centric (e.g., VR controllers and joysticks), leaving foot-operated channels underexplored for continuous base control. We present TriPilot-FF, an open-source whole-body teleoperation system for a custom bimanual mobile manipulator that introduces a foot-operated pedal with lidar-driven pedal haptics, coupled with upper-body bimanual leader-follower teleoperation. Using only a low-cost base-mounted lidar, TriPilot-FF renders a resistive pedal cue from proximity-to-obstacle signals in the commanded direction, shaping operator commands toward collision-averse behaviour without an explicit collision-avoidance controller. The system also supports arm-side force reflection for contact awareness and provides real-time force and visual guidance of bimanual manipulability to prompt mobile base repositioning, thereby improving reach. We demonstrate the capability of TriPilot-FF to effectively ``co-pilot'' the human operator over long time-horizons and tasks requiring precise mobile base movement and coordination. Finally, we incorporate teleoperation feedback signals into an Action Chunking with Transformers (ACT) policy and demonstrate improved performance when the additional information is available. We release the pedal device design, full software stack, and conduct extensive real-world evaluations on a bimanual wheeled platform. The project page of TriPilot-FF is http://bit.ly/46H3ZJT.

远程操作力反馈移动机器人人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。