arXiv:2409.16208cs.RO2024-09被引 1

用机器人运动学与未标定相机提升装配任务自适应能力

Context-Based Meta Reinforcement Learning for Robust and Adaptable Peg-in-Hole Assembly Tasks

  • 结合运动学与未标定相机信息作为上下文输入
  • 实测在真实机器人上提升样本效率与泛化性能
  • 适合需快速适应新环境的工业装配场景

自主装配是工业和服务机器人的重要能力,其中插销入孔(PiH)插入是核心任务。然而,在未知环境下,由于传感器噪声导致孔位和朝向不确定,使得PiH装配仍具挑战性。尽管已有基于上下文的元强化学习方法用于适应未知任务参数,但其性能依赖低效的采样过程或人工示范。为此,本文提出让智能体利用机器人正向运动学信息和未标定相机数据进行训练,并通过力/扭矩传感器数据高效适应;此外,还设计了针对分布外任务的适配流程。仿真与真实机器人实验表明,相比以往方法,本方案显著提升了元训练阶段的样本效率、真实环境中的适应性能以及对新任务的泛化能力。

原文摘要 · Abstract (English)

Autonomous assembly is an essential capability for industrial and service robots, with Peg-in-Hole (PiH) insertion being one of the core tasks. However, PiH assembly in unknown environments is still challenging due to uncertainty in task parameters, such as the hole position and orientation, resulting from sensor noise. Although context-based meta reinforcement learning (RL) methods have been previously presented to adapt to unknown task parameters in PiH assembly tasks, the performance depends on a sample-inefficient procedure or human demonstrations. Thus, to enhance the applicability of meta RL in real-world PiH assembly tasks, we propose to train the agent to use information from the robot's forward kinematics and an uncalibrated camera. Furthermore, we improve the performance by efficiently adapting the meta-trained agent to use data from force/torque sensor. Finally, we propose an adaptation procedure for out-of-distribution tasks whose parameters are different from the training tasks. Experiments on simulated and real robots prove that our modifications enhance the sample efficiency during meta training, real-world adaptation performance, and generalization of the context-based meta RL agent in PiH assembly tasks compared to previous approaches.

元强化学习装配任务自适应控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。