用少量示范实现跨机器人形态与任务的快速适应。
Meta-Controller: Few-Shot Imitation of Unseen Embodiments and Tasks in Continuous Control
- 通过联合级输入输出表示统一异构机器人的状态与动作空间。
- 仅需5次无奖励示范,即可在新形态和任务上实现高效泛化。
- 适合需要快速适配新机器人或新任务的工业场景应用。
在连续控制中,跨机器人形态和任务的泛化能力对自适应机器人系统至关重要。模块化策略学习方法虽能适应新形态,但局限于特定任务;而少样本模仿学习方法通常仅针对单一形态。本文提出一种少样本行为克隆框架,仅需少数(例如5个)无奖励示范,即可同时泛化至未见过的形态与任务。该框架采用关节级输入输出表示,统一异构形态的状态与动作空间,并引入一种结构-运动状态编码器,参数化设计以捕捉共性知识与形态特异性知识。基于匹配的策略网络从少量示范中预测动作,生成鲁棒且不易过拟合的适应性策略。在DeepMind Control套件上的评估表明,所提出的模型( exttt{Meta-Controller})在少样本跨形态、跨任务泛化方面优于模块化策略学习与少样本模仿学习方法。代码已公开于 https://github.com/SeongwoongCho/meta-controller。
原文摘要 · Abstract (English)
Generalizing across robot embodiments and tasks is crucial for adaptive robotic systems. Modular policy learning approaches adapt to new embodiments but are limited to specific tasks, while few-shot imitation learning (IL) approaches often focus on a single embodiment. In this paper, we introduce a few-shot behavior cloning framework to simultaneously generalize to unseen embodiments and tasks using a few (\emph{e.g.,} five) reward-free demonstrations. Our framework leverages a joint-level input-output representation to unify the state and action spaces of heterogeneous embodiments and employs a novel structure-motion state encoder that is parameterized to capture both shared knowledge across all embodiments and embodiment-specific knowledge. A matching-based policy network then predicts actions from a few demonstrations, producing an adaptive policy that is robust to over-fitting. Evaluated in the DeepMind Control suite, our framework termed \modelname{} demonstrates superior few-shot generalization to unseen embodiments and tasks over modular policy learning and few-shot IL approaches. Codes are available at \href{https://github.com/SeongwoongCho/meta-controller}{https://github.com/SeongwoongCho/meta-controller}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。