让机器人学会抓取并组合行走与抓取动作,实现自主操作复杂任务。
Developing Combined Manipulation and Locomotion Skills with Interaction Representation and Skill Composition

- 用立方谐波建模手物空间关系,通过发育式训练自主学抓取。
- 抓取成功率93%(零样本),持物起身成功率96%-100%。
- 强调全身统一训练,即使不需全身体部也需在同一体型上学习。
本文研究如何使类人机器人基于发育原则学习运动策略,并组合策略以生成更复杂实用的行为。具体提出两种方法:(1) 学习全身抓取策略,借鉴谐波分析思想,采用立方谐波作为权重,通过空间卷积表示手与物体的空间关系;利用基于发育原则的关节解耦课程,机器人可无需外部数据集或预训练模型,自主学习通用抓取策略。(2) 将抓取策略与独立学习的起身行走策略结合,通过各自观测向量输入,并使用手物交互得分决定各策略控制哪些关节。实验表明,对未见物体抓取的零样本成功率高达93%,持物起身成功率在96%至100%之间。研究还发现,策略组合仅在所有策略于同一完整类人机器人上学习时才有效,即便某策略(如行走)看似无需全部身体部件(如手指)。
原文摘要 · Abstract (English)
This paper addresses how to enable a humanoid robot to learn motion policies based on developmental principles and combine policies to create more sophisticated and useful behaviors. Specifically, we present an approach to (1) learning a whole-body reaching and grasping policy and (2) combining it and a standing-up and walking policy to compose a more complex policy of manipulation and locomotion: grasping, standing up, and walking. In (1), our method draws inspiration from harmonic analysis and adopts cubic harmonics as weights to represent the hand-object spatial relationship via spatial convolution. Utilizing an intra-episode finger joint decoupling curriculum based on developmental principles, a robot can autonomously learn a generalizable grasping policy without relying on external datasets or pretrained models. In (2), our method combines the grasping policy with a separately learned getting-up policy by providing both policies with their respective observation vectors and using hand-object interaction scores to determine when each policy should control which robot joints. Our results show a 93% zero-shot success rate for grasping unseen objects and a 96-100% success rate for standing up while holding the object. Our work also demonstrates that combining different policies is only effective if each policy learning happens on the same whole humanoid body even if a policy (such as for locomotion) does not seem to need all the body parts (such as fingers).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。