让机器人实时辅助操作员完成抓取,自动避障并保持动作精准
Sampling-Based Grasp and Collision Prediction for Assisted Teleoperation
- 通过采样配置并用神经网络预测约束代价,实现实时决策
- 在双机械臂系统中完成抓取任务,延迟极低且精度高
- 支持动态调整辅助策略,适合复杂场景下的远程操控
共享自主性可结合人类操作员的全局规划能力与机器人的重复性和精确控制优势。在实时遥操作中,一种实现方式是让操作员决定粗略运动,机器人负责精细调整,尤其在视野受阻时。本文提出一种基于学习的共享自主框架,旨在实时支持操作员。系统每步尽可能准确跟踪操作员设定的目标位姿,同时满足影响机器人行为的一组约束。关键特性在于约束可动态启停,实现任务特定的辅助。由于需实时生成机器人指令,逐次求解优化问题不可行。因此,系统采样潜在目标配置,并利用神经网络预测每个配置的约束代价。通过并行评估各配置,系统能在最小延迟下选择满足约束且距离操作员目标位姿最近的配置。我们在配备两个Franka Emika Panda机械臂和Robotiq夹具的双臂系统上评估该框架,完成抓取放置任务。
原文摘要 · Abstract (English)
Shared autonomy allows for combining the global planning capabilities of a human operator with the strengths of a robot such as repeatability and accurate control. In a real-time teleoperation setting, one possibility for shared autonomy is to let the human operator decide for the rough movement and to let the robot do fine adjustments, e.g., when the view of the operator is occluded. We present a learning-based concept for shared autonomy that aims at supporting the human operator in a real-time teleoperation setting. At every step, our system tracks the target pose set by the human operator as accurately as possible while at the same time satisfying a set of constraints which influence the robot's behavior. An important characteristic is that the constraints can be dynamically activated and deactivated which allows the system to provide task-specific assistance. Since the system must generate robot commands in real-time, solving an optimization problem in every iteration is not feasible. Instead, we sample potential target configurations and use Neural Networks for predicting the constraint costs for each configuration. By evaluating each configuration in parallel, our system is able to select the target configuration which satisfies the constraints and has the minimum distance to the operator's target pose with minimal delay. We evaluate the framework with a pick and place task on a bi-manual setup with two Franka Emika Panda robot arms with Robotiq grippers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。