用几何对齐方法让机器人持续学新技能不忘记旧技能
SPREAD: Subspace Representation Distillation for Lifelong Imitation Learning
- 通过低秩子空间分解保留任务间的几何结构
- 在LIBERO数据集上显著减少遗忘,性能达最新水平
- 只优化最可信动作样本,提升训练稳定性
终身模仿学习(LIL)的核心挑战在于,让智能体在学习新技能的同时保留已有知识,这需要保持任务表示中低维流形与几何结构的一致性。现有基于原始特征空间L2范数匹配的蒸馏方法对噪声和高维变化敏感,难以维持内在任务流形。为此,我们提出SPREAD框架,利用奇异值分解(SVD)在低秩子空间中对齐不同任务的策略表示,保持多模态特征的底层几何结构,从而实现稳定迁移、强鲁棒性与良好泛化。此外,我们设计了一种置信度引导的蒸馏策略,仅对前M个最可信动作样本应用KL散度损失,强化可靠模式,提升优化稳定性。在LIBERO终身模仿学习基准上的实验表明,SPREAD显著提升知识迁移能力,有效缓解灾难性遗忘,并达到当前最优性能。
原文摘要 · Abstract (English)
A key challenge in lifelong imitation learning (LIL) is enabling agents to acquire new skills from expert demonstrations while retaining prior knowledge. This requires preserving the low-dimensional manifolds and geometric structures that underlie task representations across sequential learning. Existing distillation methods, which rely on L2-norm feature matching in raw feature space, are sensitive to noise and high-dimensional variability, often failing to preserve intrinsic task manifolds. To address this, we introduce SPREAD, a geometry-preserving framework that employs singular value decomposition (SVD) to align policy representations across tasks within low-rank subspaces. This alignment maintains the underlying geometry of multimodal features, facilitating stable transfer, robustness, and generalization. Additionally, we propose a confidence-guided distillation strategy that applies a Kullback-Leibler divergence loss restricted to the top-M most confident action samples, emphasizing reliable modes and improving optimization stability. Experiments on the LIBERO, lifelong imitation learning benchmark, show that SPREAD substantially improves knowledge transfer, mitigates catastrophic forgetting, and achieves state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。