通过交互式反馈实现技能的局部与全局增量学习。
Interactive incremental learning of generalizable skills with local trajectory modulation
- 结合关键点与任务参数化模型,实现轨迹的局部和全局调节。
- 在7自由度机械臂上实测,支持执行中新增物体与未演示区域扩展。
- 适合需要实时调整、多物体操作的机器人技能学习场景。
学习从示范(LfD)中的泛化问题长期受到关注,尤其在运动基元框架下涌现出多种方法。一种方法利用关键点对示范轨迹进行局部调制以实现精准适应,另一种则通过任务参数化模型,基于概率乘积实现大范围工作空间的泛化,常涉及多个物体。然而,如何同时融合两种方法以提升泛化质量仍缺乏研究。本文提出一种交互式模仿学习框架,同步引入局部与全局轨迹分布调制机制。在核化运动基元(KMP)基础上,引入直接人类修正反馈的新型技能调制方式。特别地,利用关键点实现三类能力:1)在执行过程中局部提升模型精度;2)动态添加新物体至任务中;3)将技能扩展至未示范区域。我们在扭矩控制、7自由度的DLR SARA机器人上,针对轴承环装载任务验证了该方法的有效性。
原文摘要 · Abstract (English)
The problem of generalization in learning from demonstration (LfD) has received considerable attention over the years, particularly within the context of movement primitives, where a number of approaches have emerged. Recently, two important approaches have gained recognition. While one leverages via-points to adapt skills locally by modulating demonstrated trajectories, another relies on so-called task-parameterized models that encode movements with respect to different coordinate systems, using a product of probabilities for generalization. While the former are well-suited to precise, local modulations, the latter aim at generalizing over large regions of the workspace and often involve multiple objects. Addressing the quality of generalization by leveraging both approaches simultaneously has received little attention. In this work, we propose an interactive imitation learning framework that simultaneously leverages local and global modulations of trajectory distributions. Building on the kernelized movement primitives (KMP) framework, we introduce novel mechanisms for skill modulation from direct human corrective feedback. Our approach particularly exploits the concept of via-points to incrementally and interactively 1) improve the model accuracy locally, 2) add new objects to the task during execution and 3) extend the skill into regions where demonstrations were not provided. We evaluate our method on a bearing ring-loading task using a torque-controlled, 7-DoF, DLR SARA robot.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。