arXiv:2603.01480cs.RO2026-03

用高斯过程建模机器人技能,实现大偏差下的精准适应。

Towards Robot Skill Learning and Adaptation with Gaussian Processes

  • 基于稀疏路径点的高斯过程模型,保留运动学特征。
  • 三种适配方法均提升成功率,硬件与仿真表现优。
  • 适合需强泛化能力的复杂机器人任务场景。

通用机器人技能适配需要对不同任务配置具有鲁棒性的表达能力。尽管基于强化学习的近期方法已取得成功,但现有技能模型在应对环境变化时表达能力有限。相比之下,高斯过程(GP)建模具有丰富的表达能力和良好的解析性质,但其技能适配仍研究不足。本文提出一种新型稳健技能适配框架,采用稀疏路径点的高斯过程进行紧凑且表达性强的建模。模型结合轨迹姿态及其一阶、二阶导数,以保持技能的运动学特性。我们设计三种适配方法:一是优化代理调整路径点并保持演示速度;二是行为克隆代理学习优化代理输出轨迹;三是强化学习代理在保持运动学特征的同时实现在线调整。在仿真和真实硬件上对三类任务(抽屉开启、立方体推移、杆件操作)评估,所提方法在成功率上优于所有基线。结果表明,该方法在保持高余弦相似度和低速度误差方面表现优异,充分体现了运动学特性的良好保留。整体上,该框架实现了仅凭一次示范即可适应大偏差的紧凑表示。

原文摘要 · Abstract (English)

General robot skill adaptation requires expressive representations robust to varying task configurations. While recent learning-based skill adaptation methods refined via Reinforcement Learning (RL), have shown success, existing skill models often lack sufficient representational capacity for anything beyond minor environmental changes. In contrast, Gaussian Process (GP)-based skill modelling provides an expressive representation with useful analytical properties; however, adaptation of GP-based skills remains underexplored. This paper proposes a novel, robust skill adaptation framework that utilises GPs with sparse via-points for compact and expressive modelling. The model considers the trajectory's poses and leverages its first and second analytical derivatives to preserve the skill's kinematic profile. We present three adaptation methods to cater for the variability between initial and observed configurations. Firstly, an optimisation agent that adjusts the path's via-points while preserving the demonstration velocity. Second, a behaviour cloning agent trained to replicate output trajectories from the optimisation agent. Lastly, an RL agent that has learnt to modify via-points whilst maintaining the kinematic profile and enabling online capabilities. Evaluated across three tasks (drawer opening, cube-pushing and bar manipulation) in both simulation and hardware, our proposed methods outperform every benchmark in success rates. Furthermore, the results demonstrate that the GP-based representation enables all three methods to attain high cosine similarity and low velocity magnitude errors, indicating strong preservation of the kinematic profile. Overall, our formulation provides a compact representation capable of adapting to large deviations from a single demonstrated skill.

机器人技能高斯过程运动规划强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。