用局部质量信息提升机器人从不完美示范中学习的性能。
LOPAL: Local Performance-Aware Active Learning from Imperfect Demonstrations

- 基于高斯混合模型捕捉示范轨迹与局部质量,生成更优动作序列。
- 实测在管道检测任务中性能提升27.31%,减少示范收集负担。
- 适合需高效学习、示范质量不稳定的机器人场景。
示范学习(LfD)通过人类示范让机器人直观习得技能,但现有方法未解决示范中因人为行为不一致导致的质量波动问题。本文提出局部性能感知主动学习方法LOPAL,包含两个协同组件:首先,基于高斯混合模型(GMM)编码示范轨迹及其局部质量评估,生成优于原始示范的轨迹;其次,通过主动数据采集机制,在数据缺失区域利用共享自主(SA)机制请求用户修正,同时机器人自主执行已学行为。在仿真与真实世界实验中验证了有效性,真实管道检测任务中任务性能最高提升27.31%,同时显著降低示范收集成本。
原文摘要 · Abstract (English)
Learning from Demonstration (LfD) enables intuitive robot skill acquisition by allowing robots to learn directly from human task demonstrations. However, current methods often fail to address the fact that due to suboptimal and inconsistent human behavior, the quality of the demonstration can vary within each demonstration. Therefore, we introduce LOPAL (LOcal Performance-aware Active Learning), an active learning approach that leverages this local demonstration quality information. Our approach consists of two synergistic components. First, a local performance-driven LfD method uses a Gaussian Mixture Model (GMM) to encode both the demonstrated trajectories and their associated local quality assessments. This enables the generation of trajectories that outperform the imperfect demonstrations by utilizing complementary local data of high performance. Second, active data acquisition allows to improve beyond the imperfect demonstrations by collecting additional informative samples. In areas missing good data, the user is actively requested to provide corrections through a shared autonomy (SA) mechanism, while the robot autonomously executes the learned behavior. The efficacy of LOPAL was validated in both a simulation and a real-world experiment. The results from a real-world pipe inspection task showed that the proposed approach can achieve up to 27.31 % improvement in task performance while also reducing the effort required to collect the demonstrations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。