用手势控制机器人远程处理高危样本,精度达2.2毫米
GAMORA: A Gesture Articulated Meta Operative Robotic Arm for Hazardous Material Handling in Containment-Level Environments
- 通过手势+VR实时操控机械臂,结合逆运动学精准定位
- 实测定位误差仅2.2毫米,移液误差小于0.2毫升,重复性1.2毫米
- 适合生物实验室高危操作,支持训练与真实环境联动
机器人与虚拟现实的融合提升了高风险实验室(如病毒研究)的安全性与效率。针对生物危害物处理中减少人员暴露并保持精度的需求,本文提出GAMORA(手势驱动的元操作机械臂),一种基于自然手部动作的远程操控系统。该系统集成Oculus Quest 2、NVIDIA Jetson Nano与机器人操作系统(ROS),实现沉浸式实时控制、数字孪生仿真与逆运动学驱动的机械臂运动。通过Unity构建3D环境,完成实时路径规划与软硬件协同测试。在50次试验中,系统达到2.2毫米平均位置偏差(较原有4毫米显著提升)、0.2毫升以内的移液精度和1.2毫米的重复性。结合YOLOv8实现物体检测增强空间感知,能耗降低50%。数字-物理反馈回路保障了高危任务的安全、精确与可重复执行。GAMORA为生物医学研究中的机器人控制与生物安全提供了一种可扩展的沉浸式解决方案。
原文摘要 · Abstract (English)
The convergence of robotics and virtual reality (VR) has enabled safer and more efficient workflows in high-risk laboratory settings, particularly virology labs. As biohazard complexity increases, minimizing direct human exposure while maintaining precision becomes essential. We propose GAMORA (Gesture Articulated Meta Operative Robotic Arm), a novel VR-guided robotic system that enables remote execution of hazardous tasks using natural hand gestures. Unlike existing scripted automation or traditional teleoperation, GAMORA integrates the Oculus Quest 2, NVIDIA Jetson Nano, and Robot Operating System (ROS) to provide real-time immersive control, digital twin simulation, and inverse kinematics-based articulation. The system supports VR-based training and simulation while executing precision tasks in physical environments via a 3D-printed robotic arm. Inverse kinematics ensure accurate manipulation for delicate operations such as specimen handling and pipetting. The pipeline includes Unity-based 3D environment construction, real-time motion planning, and hardware-in-the-loop testing. GAMORA achieved a mean positional discrepancy of 2.2 mm (improved from 4 mm), pipetting accuracy within 0.2 mL, and repeatability of 1.2 mm across 50 trials. Integrated object detection via YOLOv8 enhances spatial awareness, while energy-efficient operation (50% reduced power output) ensures sustainable deployment. The system's digital-physical feedback loop enables safe, precise, and repeatable automation of high-risk lab tasks. GAMORA offers a scalable, immersive solution for robotic control and biosafety in biomedical research environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。