arXiv:2508.14994cs.ROcs.CV2025-08被引 2

用视觉追踪手部动作,实现机械臂的直观远程操控。

A Vision-Based Shared-Control Teleoperation Scheme for Controlling the Robotic Arm of a Four-Legged Robot

  • 通过外部摄像头+机器学习模型追踪操作者手腕位置
  • 实时将手部动作映射为机械臂指令,响应延迟低
  • 适合工业场景中对安全与易用性要求高的远程作业

在危险与偏远环境中,机器人系统需执行关键任务,要求更高的安全性与效率。四足机器人配备机械臂可实现移动与多功能操作,但其遥操作面临障碍物检测缺失与机械臂控制不直观的问题,尤其在狭小或动态变化的空间中易发生碰撞。传统摇杆或触控板操作复杂,认知负荷高。本文提出一种基于视觉的姿态估计方案,利用外部摄像头和机器学习模型实时检测操作者手腕位置,并将其直接映射为机械臂运动指令,实现直观远程控制。系统集成轨迹规划模块,能实时检测并规避与环境障碍物及自身机械臂的碰撞。在真实四足机器人上验证,系统展现出良好的实时控制性能。该方法为工业应用提供了一种低成本、高安全、易操作的遥操作解决方案,适用于高风险环境下的可靠人机协同。

原文摘要 · Abstract (English)

In hazardous and remote environments, robotic systems perform critical tasks demanding improved safety and efficiency. Among these, quadruped robots with manipulator arms offer mobility and versatility for complex operations. However, teleoperating quadruped robots is challenging due to the lack of integrated obstacle detection and intuitive control methods for the robotic arm, increasing collision risks in confined or dynamically changing workspaces. Teleoperation via joysticks or pads can be non-intuitive and demands a high level of expertise due to its complexity, culminating in a high cognitive load on the operator. To address this challenge, a teleoperation approach that directly maps human arm movements to the robotic manipulator offers a simpler and more accessible solution. This work proposes an intuitive remote control by leveraging a vision-based pose estimation pipeline that utilizes an external camera with a machine learning-based model to detect the operator's wrist position. The system maps these wrist movements into robotic arm commands to control the robot's arm in real-time. A trajectory planner ensures safe teleoperation by detecting and preventing collisions with both obstacles and the robotic arm itself. The system was validated on the real robot, demonstrating robust performance in real-time control. This teleoperation approach provides a cost-effective solution for industrial applications where safety, precision, and ease of use are paramount, ensuring reliable and intuitive robotic control in high-risk environments.

遥操作视觉跟踪四足机器人机械臂控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。